-- Logs begin at Wed 2022-05-11 05:47:14 UTC, end at Wed 2022-05-11 07:00:32 UTC. -- May 11 06:24:17.120984 dv-cinder-804757-27-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 06:24:17.129630 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 06:24:17.132263 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 06:24:17 2022] *** May 11 06:24:17.132457 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 06:24:17.132632 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 06:24:17.133017 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: nodename: dv-cinder-804757-27-iscsi May 11 06:24:17.133183 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: machine: x86_64 May 11 06:24:17.133343 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: clock source: unix May 11 06:24:17.133497 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: pcre jit disabled May 11 06:24:17.133650 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: detected number of CPU cores: 4 May 11 06:24:17.133802 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: current working directory: / May 11 06:24:17.133960 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: detected binary path: /usr/bin/uwsgi-core May 11 06:24:17.134118 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: your processes number limit is 47680 May 11 06:24:17.134275 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: your memory page size is 4096 bytes May 11 06:24:17.134427 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: detected max file descriptor number: 2048 May 11 06:24:17.134589 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: lock engine: pthread robust mutexes May 11 06:24:17.134979 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: thunder lock: enabled May 11 06:24:17.135339 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 06:24:17.135710 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 06:24:17.180538 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: Python main interpreter initialized at 0x559fc4fca9c0 May 11 06:24:17.180538 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: python threads support enabled May 11 06:24:17.180538 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: your server socket listen backlog is limited to 100 connections May 11 06:24:17.180538 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: your mercy for graceful operations on workers is 90 seconds May 11 06:24:17.180851 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: mapped 403077 bytes (393 KB) for 2 cores May 11 06:24:17.180965 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: *** Operational MODE: preforking *** May 11 06:24:17.181239 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: *** uWSGI is running in multiple interpreter mode *** May 11 06:24:17.181239 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: spawned uWSGI master process (pid: 79974) May 11 06:24:17.181430 dv-cinder-804757-27-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 06:24:17.182823 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: spawned uWSGI worker 1 (pid: 79984, cores: 1) May 11 06:24:17.183041 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: spawned uWSGI worker 2 (pid: 79985, cores: 1) May 11 06:24:17.183341 dv-cinder-804757-27-iscsi devstack@keystone.service[79974]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 06:24:22.897009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:24:22.897009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: from cryptography.utils import int_from_bytes May 11 06:24:22.897959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:24:22.897959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: from cryptography.utils import int_from_bytes May 11 06:24:22.898395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:24:22.898395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: from cryptography.utils import int_from_bytes May 11 06:24:22.899244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:24:22.899244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: from cryptography.utils import int_from_bytes May 11 06:24:22.946975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:24:22.947212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:24:22.947392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:24:22.947488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] command line args: [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:24:22.947552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:24:22.947622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] command line args: [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:24:22.947681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:24:22.947868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ================================================================================ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:24:22.947956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:24:22.948023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ================================================================================ {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:24:22.948086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] admin_token = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] admin_token = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_dir = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] config_dir = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] config_source = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] debug = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.948864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] config_source = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.949007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] debug = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.951744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_config_append = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_config_append = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_dir = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_dir = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.952994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_file = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.953994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.954840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.955572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.955754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.955754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] publish_errors = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.956141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] publish_errors = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.956342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.956577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.956577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.956920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.957110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.957306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.957503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.957826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.958042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.958242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.958444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] standard_threads = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.958613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] standard_threads = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.958842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.959016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.959209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.959470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.959639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.959838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] use_journal = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_journal = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] use_json = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_json = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] use_stderr = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.960920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_stderr = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.961061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] use_syslog = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.961223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] use_syslog = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.961393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.961530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:24:22.961665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.961800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.961939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.962997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.963889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.964947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.965888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.966948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.967943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.968999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.969988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.970916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.971901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.972996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.973125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.973263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.973399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.973533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.973661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.974838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.975012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.975246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.975452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.975646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.975877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.976045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.976238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.976465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.976634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.976826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.977018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.977214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.977416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.977645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.977813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.978080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.978279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.978473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.978697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.978905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.979072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.979315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.979486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.979679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.979842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.980891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.981879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.982983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.983950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.984870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.985992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.986983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.987974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.988938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.989933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.990905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.991881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.992799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.external = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.external = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.993865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.password = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] auth.token = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.password = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] auth.token = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.994948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.995920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.996980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.997917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.998048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.998277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.998412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999057 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999626 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:22.999886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.000945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.001943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.002947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.003943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.004863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.005916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.006994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.007951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.008875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.009879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.010946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.011891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.012949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.013866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.014005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.014166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.014878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.015993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.016925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.017882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.018949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.019913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.020976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021628 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.021905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.022981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.023931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.024864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.025933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.026982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.027858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.028925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.029971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.030910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.031937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] role.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] role.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.032884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.033952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.034869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.035974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.036890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.037959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.038771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.039992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.040924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.041880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042434 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.042995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.043989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.044930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.045976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.connection = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.046869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.047913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.048901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.049864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050423 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.050984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.051923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:24:23.052192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.052192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.052192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.052192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:24:23.052192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:24:23.067437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.067706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.067851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.067991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.068070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.068135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.073245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.073453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.101980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.102213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.102358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.102514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.155950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.156572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.208534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.208830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.209005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.209153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.275286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.275550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.275703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.275855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.276877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.277016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.300960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.301874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.313132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.313417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.327858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.328975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.329819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 06:24:23.346177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.346386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:24:23.346718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.346866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.347019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:24:23.347162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:24:23.347336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.347483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.347621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.348978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 06:24:23.349155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.349303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.349443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.349593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.349593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.349593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.359406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.359679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.359943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.360091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.360231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.360383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.360617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.360897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.368294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.369030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.371573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.371828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.372108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.372333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.372495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.372646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.372787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.372926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.373870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.374861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.375120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.404611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.404862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.405519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.405519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.405811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.405811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.409809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.410038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.410322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.410778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.411053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.411352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.417674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.417948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.418632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.418909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.422627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.422906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.423182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.423493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.423643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.423797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.423940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.424078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.424216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.424354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.424502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.429105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.429824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.429824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.429824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.429824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.443504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.443778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.444312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.444591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.448268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.449128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.452418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.452708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.453312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.453606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.457642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.458550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.461220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.462138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.464950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.465243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.465522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.465799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.465948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.466959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.467236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.485728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.486096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.486358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.486620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.486840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.487212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.487514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.487779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.494553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.495924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.496281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.496549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.497654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.497928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.499874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.500080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.500332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.500608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.500877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.501045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.501322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.501607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.501892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.502168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.514774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.515048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.515342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.515624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.515894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.516111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.516260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.516399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.516536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.516685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.516927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.517204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.517481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.517750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.534868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.536369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.538145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.539661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.541737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.543046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.543370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.544680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.544992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.545261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.545567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.546621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.546898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.547395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.552950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.554544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.554936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.556577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.557784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.558069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.558347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.558616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.559822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.560108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.560386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.560657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.568568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.568857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.569130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.570652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.570933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.571211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.577564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.577835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.578113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.578384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.578648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.578927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.579196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.579513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.579733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.579995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.580142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 06:24:23.580327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.580563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.580784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.581986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.582582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.582582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.583006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.583006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.583491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.583491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 06:24:23.619729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fc4fca9c0 pid: 79985 (default app) May 11 06:24:23.622507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fc4fca9c0 pid: 79984 (default app) May 11 06:24:23.623121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761741d-1d0d-4412-a677-a91486d44aac None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:23.623441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761741d-1d0d-4412-a677-a91486d44aac None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:23.624251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761741d-1d0d-4412-a677-a91486d44aac None None] PATH_INFO: `/v3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:23.628437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed May 11 06:24:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:31.610406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:31.610963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:31.610963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:31.615254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:31.620496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:31.620891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:31.621163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:31.651419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG oslo_db.sqlalchemy.engines [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:24:31.833494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG passlib.handlers.bcrypt [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79985) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 06:24:31.833842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG passlib.handlers.bcrypt [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79985) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 06:24:31.889039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:31.890642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:32.009253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 06:24:32.145193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:32.179196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG oslo_db.sqlalchemy.engines [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:24:32.304467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66ef9-638e-43cc-8c55-b4df79ee04b6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:32.308628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:32.309289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:32.309574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:32.309849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:32.318048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:32.369738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING keystone.common.rbac_enforcer.enforcer [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 06:24:32.370082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e4ac5-addf-49fc-8bb8-9488b16d8307 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:32.379504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed May 11 06:24:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:24:32.385347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:32.399962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19dcb-8257-4a93-ba44-c53422961964 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:32.407508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:32.408646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:32.408929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:32.409200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] PATH_INFO: `/v3/projects/cddb71d6492441b395049ab068255bc5` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:32.410717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] RBAC: Authorizing `identity:get_project(project_id=cddb71d6492441b395049ab068255bc5)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:32.461051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 06:24:32.461395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9337-5769-437f-98bb-9c1d8db14293 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:32.465990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed May 11 06:24:32 2022] GET /identity/v3/projects/cddb71d6492441b395049ab068255bc5 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:34.659517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b27f-18dd-4095-b369-1a68f64adf5f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:34.660048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b27f-18dd-4095-b369-1a68f64adf5f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:34.660048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b27f-18dd-4095-b369-1a68f64adf5f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:34.664213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:34.669612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:34.669978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:34.670681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:34.690828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:34.692539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:34.700127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 06:24:34.722170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80b27f-18dd-4095-b369-1a68f64adf5f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:34.734336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80b27f-18dd-4095-b369-1a68f64adf5f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:34.738479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:34.739103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:34.739417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:34.739692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:34.747118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:34.749531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17683f58-f8b2-4f42-af20-c1c6c33e3498 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:34.757954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed May 11 06:24:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:24:34.762911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:34.771515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72d4ac-a5f8-48a5-a873-b9e64076015e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:34.775724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:34.776560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:34.776840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:34.777114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:34.778498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:34.780334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf673e6-f6b2-43c8-96fb-8f31d7419c7b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:34.781857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed May 11 06:24:34 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:37.033066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348facd3-0490-4b4f-9602-4602a66ff3dc None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.033615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348facd3-0490-4b4f-9602-4602a66ff3dc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.033615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348facd3-0490-4b4f-9602-4602a66ff3dc None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.034965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:37.040069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.040450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.040627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.059013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b845e-f3dd-45f1-ab76-f5d83c62f933 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.059329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b845e-f3dd-45f1-ab76-f5d83c62f933 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.059615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b845e-f3dd-45f1-ab76-f5d83c62f933 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.061572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:37.067779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.068067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.068344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.110424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG passlib.handlers.bcrypt [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79984) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 06:24:37.110840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG passlib.handlers.bcrypt [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79984) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 06:24:37.157703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:37.159336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:37.166307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:37.167485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:37.244103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:37.255634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:37.267132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.276964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.361140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830213-fc59-4913-871b-9a3d1811b3b3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.371496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991b58-1ff1-466b-acda-04e7821609e4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.391839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.392630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.392913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.393181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.402530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.403565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.403774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:37.403883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.404109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:37.415303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:37.416392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:37.417193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:37.422605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.475184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.476724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.516905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2951a-0ec6-433a-8d38-9126c0cf39d4 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.548139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.548794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.549071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.549345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.550079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:37.550380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.551802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.563279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:37.569056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.569742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:24:37.574642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.661046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671c36-fa28-4c01-8150-fd18cefc1d2a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.668731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e8da-3ba5-4744-aab0-97b4793792cd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.693611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.694475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.694748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.695014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.696234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.697681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.699301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:37.699783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.700648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.700937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.701210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.705070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.803382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160f33d-a3cd-4b7f-953b-0878981eee10 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.828301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.829760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.836681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.837471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.837755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.838021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.839177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.840690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.842315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:37.847886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:24:37.850299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:37.851247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:37.852083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:24:37.852083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:24:37.852083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:24:37.852083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:37.852083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:24:37.857138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:37.938761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b28ddf-0b42-42f8-af3b-291caf697cd1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.951173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256aab-83a1-4c36-adb1-2aaabc13355e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:37.976050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.976701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.976980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.977250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.978078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.domain.id=default, user.id=3d67c7af6def40d481bce9d42fed2d4f) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:37.978380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.979841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992b788-2119-42f2-923e-fe1bc69c3726 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:37.986353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/role_assignments?user.id=3d67c7af6def40d481bce9d42fed2d4f&scope.domain.id=default&role.id=991b05c688cb448e83689717b7104be0 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:37.991399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:37.992086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:37.992369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:37.992644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:37.993389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:37.993699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:37.995131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ee23a-bdf9-44cb-a611-88e6c341cce0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:38.015722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:40.414606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16c4a-d190-448d-8e32-f1678b82318a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:40.415118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16c4a-d190-448d-8e32-f1678b82318a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:40.415191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16c4a-d190-448d-8e32-f1678b82318a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:40.416725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:40.422612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:40.423562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:40.424041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:40.452251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:40.453752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:40.532573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:40.565431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e16c4a-d190-448d-8e32-f1678b82318a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:40.701152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e16c4a-d190-448d-8e32-f1678b82318a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:40.745810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:40.747005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:40.747535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:40.748003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:40.764288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-18aee1e8-9eac-4be0-8cd8-316996b96fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:40.772178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:40.773001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:40.773757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:40.780542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 13/24] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:40.788418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:40.884457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6821-577f-4f6b-ad75-5554f9182015 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:40.885078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6821-577f-4f6b-ad75-5554f9182015 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:40.885580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6821-577f-4f6b-ad75-5554f9182015 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:40.889409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 14/25] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:40.894506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:40.894993 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:40.895498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:40.915661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:40.917186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:40.998997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 15/26] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:41.034973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f5c0f-c266-4163-b8ff-d02465e62b4c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.041627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.104492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.105173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.105457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.105733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.106486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:41.106791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.108776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.138912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 12/27] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:41.141250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.199648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d60a0-a72b-4886-a74e-762c20872acc None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.235378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.236445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.236922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.237373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.249190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.250943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-620b6f4c-fe49-4fa7-a69d-0c187319f200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:24:41.281931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:41.282765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:41.283672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:24:41.283672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:24:41.283672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:24:41.283672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:41.286044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 16/28] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:24:41.287596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706845-1175-4802-8674-43d7f519d972 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.288052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706845-1175-4802-8674-43d7f519d972 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.288485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706845-1175-4802-8674-43d7f519d972 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.290254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 17/29] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:41.293148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbe3b-8543-4727-863e-1aceca43d9f9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.295564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d3e7-5f46-496c-ab24-c2e933adbbb3 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.295931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d3e7-5f46-496c-ab24-c2e933adbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.296413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d3e7-5f46-496c-ab24-c2e933adbbb3 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.298145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 18/30] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:41.299042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d3e7-5f46-496c-ab24-c2e933adbbb3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.332288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.333562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.334053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.334512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.336409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.338104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e544c-9593-4440-87b7-e3cb57bb0db2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.340405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 13/31] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:41 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:41.346673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9eff-bc38-48b1-b45d-079bb20b9a45 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.347185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9eff-bc38-48b1-b45d-079bb20b9a45 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.347684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9eff-bc38-48b1-b45d-079bb20b9a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.364274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-57ea9eff-bc38-48b1-b45d-079bb20b9a45 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:41.365761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-57ea9eff-bc38-48b1-b45d-079bb20b9a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:41.423932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d3e7-5f46-496c-ab24-c2e933adbbb3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.452037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 14/32] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:41.454057 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.454537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.454998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.461984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.462899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.463434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.463918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.465587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:41.466113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.468288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.479857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:41.481223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:41.487455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 19/33] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:41.489172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.562808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 15/34] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:41.572419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.592651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffc7d-d86a-4268-9ffa-42b7d0238e19 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.626142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.627231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.627779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.628240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.629609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.631240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.633443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 20/35] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:41.634368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.694510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d354d44-76d3-4624-b633-be43b6851274 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.729458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.730298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.730661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.731028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.731896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.733505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.734940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bef697-4d94-4a3e-96ba-dafc328b417a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:41.771060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:41.772059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:41.772565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:41.773057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:41.773971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:41.775705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:41.884625 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 16/36] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:24:41 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:41.885751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:41.905655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 21/37] 10.222.0.64 () {60 vars in 1131 bytes} [Wed May 11 06:24:41 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:41.912593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:42.103315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0a7a-0e90-4bc0-bbef-42d0e4e2d7b2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:42.118684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfc6e3-4435-4352-99c5-d17fea914956 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:42.164306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:42.164952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.165230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.165504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.166278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:42.167890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae46ff-fedb-493d-b737-30e25154ed0b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:42.178514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:42.179518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.179834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.180116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] PATH_INFO: `/v3/domains/default/users/3d67c7af6def40d481bce9d42fed2d4f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.183921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3d67c7af6def40d481bce9d42fed2d4f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:42.185519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:42.195667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 17/38] 10.222.0.64 () {60 vars in 1131 bytes} [Wed May 11 06:24:41 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:42.197099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b01ad-ecc0-4ea2-93c5-e2be113cb6a6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.197384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b01ad-ecc0-4ea2-93c5-e2be113cb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.197665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b01ad-ecc0-4ea2-93c5-e2be113cb6a6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.200266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 18/39] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:42.210703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1361 bytes} [Wed May 11 06:24:41 2022] PUT /identity/v3/domains/default/users/3d67c7af6def40d481bce9d42fed2d4f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:24:42.228953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d24e-b7ef-47ef-b6ab-53f86105041f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.229573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d24e-b7ef-47ef-b6ab-53f86105041f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.229915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d24e-b7ef-47ef-b6ab-53f86105041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.257432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-93f9d24e-b7ef-47ef-b6ab-53f86105041f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:42.259154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-93f9d24e-b7ef-47ef-b6ab-53f86105041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:42.352220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 19/41] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:42.380238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:42.423183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03154b-36be-4640-8a7e-a38e1e06239f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.423563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03154b-36be-4640-8a7e-a38e1e06239f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.423755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03154b-36be-4640-8a7e-a38e1e06239f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.430415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 20/42] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:42.436173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.436465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.436746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.457781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:42.459725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:42.510692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d2744-d0fa-4501-8f27-66b53df362f0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:42.540448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 21/43] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:42.544380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:42.545670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.545956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.546228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.546987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:42.548398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:42.561772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1131 bytes} [Wed May 11 06:24:42 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:42.564385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:42.669312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a354-e858-48e6-8900-6e0712cdee92 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:42.705712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:42.706437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.706720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.706994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.708215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:42.709764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569b86d-da80-4912-ad49-30f2f4a1eb9e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:42.711851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 22/45] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:42.717892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:42.817834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b308a0-7662-45e2-80b8-d74dd08419f5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:42.849890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:42.850545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:42.850826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:42.851100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:42.851830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:42.853272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d112b-421f-41a3-804c-d7dfc07b5119 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:42.878892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:24:42 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:44.520868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14ed0-bf3c-4744-88d8-ba69a142d88e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:44.521363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14ed0-bf3c-4744-88d8-ba69a142d88e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:44.521467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14ed0-bf3c-4744-88d8-ba69a142d88e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:44.522806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 23/47] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:44.528202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:44.528572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:44.528868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:44.546901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:44.549593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:44.615151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 25/48] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:44.637886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14ed0-bf3c-4744-88d8-ba69a142d88e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:44.734274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14ed0-bf3c-4744-88d8-ba69a142d88e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:44.767041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:44.767871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:44.768161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:44.768439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:44.779335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:44.788132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:44.789013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:44.789767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 24/49] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:44.795208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:44.887546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bef98-2e69-4ff3-a2dd-13747f6dc367 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:44.921469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:44.922164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:44.922451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:44.922730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:44.923534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:44.923849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:44.925305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:44.934602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 26/50] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:44.940429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:45.037946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388ee37-b80e-4562-933c-5f3049736ed3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:45.068819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:45.069692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.069976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.070250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.071461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:45.072913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66d7e-6392-46ea-bf15-49a9e78fa314 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:45.074545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 25/51] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:44 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:45.080520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:45.113403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae41bf3-962d-40a3-91fd-9278496b75ee None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.113689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae41bf3-962d-40a3-91fd-9278496b75ee None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.113966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae41bf3-962d-40a3-91fd-9278496b75ee None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.115358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 26/52] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:45.120261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.120551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.120829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.136634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:45.137796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:45.174424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395f91c-ae84-461a-90f3-54e239577096 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:45.200667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 27/53] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:45.206419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:45.207217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.207547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.207827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.208994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:45.210436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:45.212191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 27/54] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:45.218243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:45.223555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:45.309829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5f3b-a71a-4b62-b0f8-726034249dd7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:45.315346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e772-1b55-4772-803a-34dff039142b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:45.342010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c28171-892d-4062-ba7d-09616164237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:45.342656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c28171-892d-4062-ba7d-09616164237d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.342938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c28171-892d-4062-ba7d-09616164237d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.343248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c28171-892d-4062-ba7d-09616164237d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.344095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c28171-892d-4062-ba7d-09616164237d None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.domain.id=default, user.id=3d67c7af6def40d481bce9d42fed2d4f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:45.344401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c28171-892d-4062-ba7d-09616164237d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:45.345817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c28171-892d-4062-ba7d-09616164237d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:45.346950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:45.347769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.348058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.348338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.349501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:45.350923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:45.352576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:45.354873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 28/56] 10.222.0.64 () {56 vars in 1322 bytes} [Wed May 11 06:24:45 2022] GET /identity/v3/role_assignments?user.id=3d67c7af6def40d481bce9d42fed2d4f&scope.domain.id=default&role.id=991b05c688cb448e83689717b7104be0 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:45.358021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:45.468222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ea37-c321-472f-9801-479ce11fb9c0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:45.505298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:45.505977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:45.506270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:45.506550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:45.507317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:45.508796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbccf83-0b46-429a-8629-d917b2e462e7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:45.534947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 29/57] 10.222.0.64 () {60 vars in 1140 bytes} [Wed May 11 06:24:45 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:47.742834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc452e-f7c5-4495-a281-38b8bd4d907c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:47.743354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc452e-f7c5-4495-a281-38b8bd4d907c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:47.743354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc452e-f7c5-4495-a281-38b8bd4d907c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:47.744713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 29/58] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:47.749953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:47.750370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:47.750517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:47.766488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:47.767716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:47.832254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:47.856344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc452e-f7c5-4495-a281-38b8bd4d907c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:47.957461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc452e-f7c5-4495-a281-38b8bd4d907c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:47.988707 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:47.989498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:47.989783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:47.990060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:47.991236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:47.992720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4f263-a9b7-4a87-b659-e957720a1014 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:47.994379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 30/60] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:47.999856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:48.090067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af84bf3-f16b-4062-848d-27086efda8ad None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:48.121137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:48.121789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:48.122073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:48.122343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:48.123072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:48.124557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6e6f3-a75a-49ac-986f-30bbc5845235 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:48.151490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:24:47 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:51.418517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db73c2-eba7-4f41-9f5f-7579ff68367c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.419573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db73c2-eba7-4f41-9f5f-7579ff68367c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.420135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db73c2-eba7-4f41-9f5f-7579ff68367c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.422012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 31/62] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:51.427971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c0cd0-8e7c-4181-92e5-6a01f494cff8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.428843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c0cd0-8e7c-4181-92e5-6a01f494cff8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.429318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c0cd0-8e7c-4181-92e5-6a01f494cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.455863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-de4c0cd0-8e7c-4181-92e5-6a01f494cff8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:51.457376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-de4c0cd0-8e7c-4181-92e5-6a01f494cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:51.545042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 32/63] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:51.592870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db73c2-eba7-4f41-9f5f-7579ff68367c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:51.746548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db73c2-eba7-4f41-9f5f-7579ff68367c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:51.789618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:51.790436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.790723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.791003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.808139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:51.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:51.816748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:51.818190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 32/64] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:51.823302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985b92-13eb-4f89-9399-f1f0085b8c9b None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.823302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985b92-13eb-4f89-9399-f1f0085b8c9b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.823302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb985b92-13eb-4f89-9399-f1f0085b8c9b None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.826578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 33/65] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:51.830021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:51.831010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed939be-dc1e-4450-8226-989828666c91 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.831010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed939be-dc1e-4450-8226-989828666c91 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.831010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed939be-dc1e-4450-8226-989828666c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.868292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4ed939be-dc1e-4450-8226-989828666c91 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:51.869488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4ed939be-dc1e-4450-8226-989828666c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:51.942949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10df66-0741-4155-bf31-32d5a772bfec None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26dac-f5fc-422d-a318-7b40d731bcc4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26dac-f5fc-422d-a318-7b40d731bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26dac-f5fc-422d-a318-7b40d731bcc4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 35/67] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:51.957615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a550a1-8cfd-44b4-8fe0-0e2d586579c7 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.958090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a550a1-8cfd-44b4-8fe0-0e2d586579c7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.958090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a550a1-8cfd-44b4-8fe0-0e2d586579c7 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.963328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 36/68] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:51.964620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.964899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.965178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.983462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:51.984684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:51.989802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:51.990476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:51.990760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:51.991037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:51.991820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:51.992123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:51.993497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb246f-42fe-4116-aa53-af97ba5c903e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.001896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 33/69] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.003031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.003339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.003620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.020759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:52.021925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:52.059383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 37/70] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:52.061370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.086178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 34/71] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:52.087030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.171620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0f34-9fcd-4d76-b9eb-a2a10e513ee2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.188370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524b96-7207-41b5-8208-8989ebaf53b3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.203260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.204081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.204363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.204632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.214074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:52.220305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.221159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.221438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:52.221655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:52.222620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:52.223421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:52.223991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.224062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 38/72] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:52.224062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.238582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.240037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.241742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 35/73] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.242494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.318408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096a42-f37d-4f06-aa40-23e56f713ea8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.334302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a49074-ee8a-4ff0-ad13-d8737b64842f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.350183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.350991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.351296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.351572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.361200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:52.368401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3511c9ec-a3a6-4cba-8044-75a3f24e1618 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:52.369108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:52.370067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:24:52.370861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:52.371466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.371466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.371466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.371644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 39/74] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:52.371715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.372292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.372678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4d8-64db-4cdb-865b-0c1a4ed408a8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.373481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4d8-64db-4cdb-865b-0c1a4ed408a8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.373760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4d8-64db-4cdb-865b-0c1a4ed408a8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.374572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 36/75] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.375175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.379330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 40/76] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:52.380065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7de4d8-64db-4cdb-865b-0c1a4ed408a8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.468967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7990c79-87ac-48bd-bc09-0a6a55991be3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.477313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7de4d8-64db-4cdb-865b-0c1a4ed408a8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.501704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.502374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.502666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.502951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.503734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:52.504048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.505440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.518419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 37/77] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.518419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.519037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.519734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.520023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.520299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.583410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.584822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1a39-8cf3-4f7a-8c61-9c42986f34d6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.610833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c532-1677-4786-8f21-0a2fb9ff53ed None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.642460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.643123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.643440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.643727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.644472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:52.644779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.646142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.653696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 38/78] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.654486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.681376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 41/79] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:24:52.681376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.681376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.681376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.695133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:52.696349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:52.756040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d038-9b51-4b78-9602-1f6957fb5666 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.756994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 42/80] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:52.757813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.787912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.788584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.788929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.789212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.789916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.791375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.816760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 39/81] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:24:52 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:52.817816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.853929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5004-3421-4f43-a566-6dcf1c24df90 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.890112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.890999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.891303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.891588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.892823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.894362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.900624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 43/82] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.900624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:52.924075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88df641-7ea0-48ef-8f52-0145c4af1516 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:52.958633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:52.959553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:52.959839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:52.960116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:52.961367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:52.962830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:52.969792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 40/83] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:52.969792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.003361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468963d-b3cb-4260-864d-cb68a5902e20 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.037150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.038017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.038299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.038569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.039827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.041287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.042999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 44/84] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.047915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.072569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7665bd-62ad-444e-9baa-6b1b617e1fca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.112808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.113554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.113842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.114122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.127304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:53.135088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:53.136015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:53.136755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 41/85] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:53.137360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.149305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43683510-ba2f-4781-a25d-1bf93cc69b30 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.184364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.185024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.185308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.185617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.245761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cc81-45b3-452d-b44f-c816fba7bd71 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.267696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.269982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.280069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.280791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.281074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.281391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.352212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.353713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.399392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 45/86] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:24:53.400329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.460228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 42/87] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:24:53.461382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.503518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc28b2-e63f-499b-ba76-2319edc92761 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.538470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade635-de00-454d-a233-071833404013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.539477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade635-de00-454d-a233-071833404013 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.539716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade635-de00-454d-a233-071833404013 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.540098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade635-de00-454d-a233-071833404013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.541044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade635-de00-454d-a233-071833404013 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:53.541464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade635-de00-454d-a233-071833404013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.543070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade635-de00-454d-a233-071833404013 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.549097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 46/88] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=834e56c266a046559104d936315ca310 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.549970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade635-de00-454d-a233-071833404013 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.567612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552951-0c3a-4fec-a884-c5f009348b6e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.606420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.607468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.607898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.608318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.609235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:53.609716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.611294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.630030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 43/89] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.631194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.675769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade635-de00-454d-a233-071833404013 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.717274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.718314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.718703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.719080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.720408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.729049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.731347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 47/90] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.732096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.769294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb4e75-fb28-4add-bb26-98f2b1bba185 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.806602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.807863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.808319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.808722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.814683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.816420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.819075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 44/91] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.822491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:53.930213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362dac7-b9e8-4834-b1a2-3ae028b86c5d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.964725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:53.965637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:53.966063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:53.966476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:53.967579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=3d67c7af6def40d481bce9d42fed2d4f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:53.968032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:53.969616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:53.970893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368448-198e-446b-89f2-b0a53eccc4c3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:53.976060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 45/92] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/role_assignments?user.id=3d67c7af6def40d481bce9d42fed2d4f&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:53.977032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:54.069810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:54.070698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:54.070974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:54.071246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:54.076213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:54.077776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:54.079780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 48/93] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:54.085021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:54.086951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1d97-a28e-45a3-bd0b-03d292c64f9c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:54.123767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:54.124709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:54.125151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:54.125576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:54.126618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:54.127127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:54.128768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:54.135254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 46/94] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:24:53 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=0b454d4febc34038bd35eda57f52340d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:54.263822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc27b-5670-46d3-8073-afb70b607b97 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:54.315106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:54.316014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:54.316425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:54.316803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:54.412533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:54.414105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:54.524148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 49/95] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:24:54.530416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:54.643124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78c9d8-9e38-471e-8f45-7fbbf9e42577 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:54.685449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:54.686382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:54.686697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:54.686986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] PATH_INFO: `/v3/projects/b695cb288d3546d992673990681be539` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:54.691980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] RBAC: Authorizing `identity:get_project(project_id=b695cb288d3546d992673990681be539)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:54.693704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb9a9a-dd5a-41d3-9bd2-9cf8e82bc103 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:54.695655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 47/96] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:54 2022] GET /identity/v3/projects/b695cb288d3546d992673990681be539 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:54.701737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:54.803000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6466fd-d6a2-4575-85d1-354dd182770c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:54.837199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:54.837872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:54.838157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:54.838429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:54.839281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=b695cb288d3546d992673990681be539, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:54.839602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:54.841172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8dfa1-c395-4ede-b144-4c59290a0f27 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:54.847748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 50/97] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:24:54 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=b695cb288d3546d992673990681be539&role.id=834e56c266a046559104d936315ca310 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:55.564348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1c50-f6de-430f-8c1a-64522af7fe15 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:55.564705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1c50-f6de-430f-8c1a-64522af7fe15 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:55.564911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1c50-f6de-430f-8c1a-64522af7fe15 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:55.566566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 48/98] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:55.572142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:55.572593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:55.572760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:55.596249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:55.597445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:55.677736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 51/99] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:55.720303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1c50-f6de-430f-8c1a-64522af7fe15 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:55.844611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1c50-f6de-430f-8c1a-64522af7fe15 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:55.885149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:55.885958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:55.886242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:55.886521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:55.896992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:55.905966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:55.906824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:24:55.907628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:55.908197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 49/100] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:55.914663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.035006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b701e-aabe-4369-9336-5b8afd1e44c2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:56.077220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:56.077904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.078188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.078463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.079219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:56.079562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:56.080944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:56.094806 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 52/101] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:56.100227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.246728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d95b17-d334-49c4-a71e-e68e1ce3950e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:56.294775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:56.295595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.295882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.296157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] PATH_INFO: `/v3/users/d94c960723ea40a5abad35e3d3324857` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.310016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d94c960723ea40a5abad35e3d3324857)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:56.315637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919f44-80c8-4ce2-8414-71b4e90bf6c4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:56.318096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 50/102] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:56 2022] GET /identity/v3/users/d94c960723ea40a5abad35e3d3324857 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:56.324368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.408686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87635c-3693-4a56-91ed-21ec2cbe8352 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.408987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87635c-3693-4a56-91ed-21ec2cbe8352 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.409244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87635c-3693-4a56-91ed-21ec2cbe8352 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.410626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 51/103] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:56.415606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.415893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.416172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.438575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:56.442248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:56.490916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ded28-5abf-41a9-8f25-8e9434def082 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:56.567361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:56.568633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.569128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.569599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.573145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 52/104] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:56.628125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.643157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:56.647290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:56.742582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 53/105] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:24:56.748730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.847032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a488a2-7ed1-44b0-91ea-c6a96a55a59f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:56.851038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c1cf-e433-415b-86b0-9a1ed32fb20f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:56.891292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:56.892185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.892468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.892737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.895251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:56.896723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:56.898431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 54/106] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:56 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:56.900426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:56.901448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:56.901930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:56.902421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:56.903831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:56.903935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:56.906237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:56.908123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 53/107] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:24:56.916204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:57.007903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc6e9-ac56-4c17-beed-62074ea150a0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:57.052499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:57.053162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.053447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.053718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.054546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=d94c960723ea40a5abad35e3d3324857) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:57.054859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:57.056311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2de7d-cd8c-4611-a9c3-7650f7016358 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:57.062073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 55/108] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:24:56 2022] GET /identity/v3/role_assignments?user.id=d94c960723ea40a5abad35e3d3324857&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=bf63f7b41559454a964448f2cc159a20 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:57.088385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f5a0-a3b6-4dd6-9b1e-dd1306290119 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:57.136067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:57.137083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.137568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.138084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.139595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:57.141254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59db1c-6f4c-4dab-aa29-99bad1dc2d60 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:57.179253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 54/109] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:24:56 2022] POST /identity/v3/projects => generated 302 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:24:57.433634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b0ef-411f-4fe7-be62-e02edb8ba820 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.433634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b0ef-411f-4fe7-be62-e02edb8ba820 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.433634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b0ef-411f-4fe7-be62-e02edb8ba820 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.434404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 56/110] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:57.441983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadf49-04ef-438f-ad32-c6bf719bbdcd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.442878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadf49-04ef-438f-ad32-c6bf719bbdcd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.443444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadf49-04ef-438f-ad32-c6bf719bbdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.472578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-64fadf49-04ef-438f-ad32-c6bf719bbdcd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:57.474169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-64fadf49-04ef-438f-ad32-c6bf719bbdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:57.556852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fb44-6b03-469f-8711-c578fa3257e1 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.557195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fb44-6b03-469f-8711-c578fa3257e1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.557406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fb44-6b03-469f-8711-c578fa3257e1 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.558771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 57/111] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:57.561267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 55/112] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:57.576701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b2b4-0ebf-44da-948d-2eed6628cbb0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.576886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.577022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.577484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b2b4-0ebf-44da-948d-2eed6628cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.577775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b2b4-0ebf-44da-948d-2eed6628cbb0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.577974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.579195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 56/113] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:24:57.584428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.584718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.585003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.601487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:57.602733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:57.608605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:57.609782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:57.682757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 58/114] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:57.684261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:57.691334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 57/115] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:24:57.719744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:57.804518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c3115-6edc-4cd1-a610-48990ef87c7f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:57.823641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bd7e-4a52-4f06-9fc8-047b96d34654 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:57.843580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:57.844399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.844881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.845346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.865992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:57.872269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:57.874779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:57.874779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:57.874779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:57.878482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:57.879374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 59/116] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:57.880555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:57.894127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:57.907358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:57.909395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:57.911321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 58/117] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:24:57.916206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.031568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa348-e7ff-47af-a6a7-6dde76e165c5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.070049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.071113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.072632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.073150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.082577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa2734-b630-4031-ab41-326d89a22ae2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.104187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:58.115994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:58.117018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:24:58.117739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:24:58.120604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 60/118] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:58.122011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.127224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.128107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.128543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.128973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.129871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:58.130320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.131891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.152387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 59/119] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.153496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.265397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa614a-328e-4868-882f-0482f08f5f94 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.281214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efce6-489f-441a-9a85-96fd01a1342a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.314560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.315652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.316010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.316232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.316547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.317254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.317685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:58.318061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.318328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.318827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.319672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.320012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:58.320491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.322004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c48cfc-ad3f-4300-8e3d-25818c09f656 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.329378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 61/120] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.330106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.331056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 60/121] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.332588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418155-bf84-4d5f-be54-5118f86c9278 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.333148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418155-bf84-4d5f-be54-5118f86c9278 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.333690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418155-bf84-4d5f-be54-5118f86c9278 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.335365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 61/122] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:24:58.336257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418155-bf84-4d5f-be54-5118f86c9278 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.455396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418155-bf84-4d5f-be54-5118f86c9278 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.456677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ef903-4505-4721-a50f-b560e5538b92 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.496075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.496963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.497560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.497879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.498168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.498449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.498693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.499163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.499709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.500795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.501164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.502687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c712-98e3-4e96-a681-9ee3af6873da None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.507364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 62/123] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.507364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.510489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 62/124] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.512103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.512586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.513064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.534857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:24:58.537047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:24:58.613127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 63/125] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:24:58.614233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.622124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703df623-5976-4731-aeb1-ade9f67dd247 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.673685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.674776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.675214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.675625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.677030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.678597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.680548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 63/126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.681342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.719238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff07e63-59a2-4ebb-9d0c-805b6147e5a8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.752762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.753914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.754363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.754822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.756200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.757832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.759754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 64/127] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.760727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.784694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec785ac-a876-49c0-b108-cf6606f5a275 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.820488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.821357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.821633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.821908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.823151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.824705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.827084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 64/128] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.827865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.868454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09395861-744f-43b8-973f-1c866c00df1b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.903338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.904997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.905490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.905964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.916396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:24:58.924318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:24:58.925176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:24:58.925934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:24:58.928248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99e9f8-e183-468e-8911-6b8e4f84ea7b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:58.928891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 65/129] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:24:58.929846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:58.972718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:58.974133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:58.974625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:58.975093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:58.977542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:58.979195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:58.981832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 65/130] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:58 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:58.983945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.051937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426141c-3b17-4b64-a349-1f666124f46e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.087578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.088805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.089296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.089780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/cdd044c2ea3248288976374719a9f803/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.092800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, user_id=cdd044c2ea3248288976374719a9f803, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.094441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ca13-298f-42a2-9de2-631f2bc5a7ae None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.094721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.113385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 66/131] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:24:58 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/cdd044c2ea3248288976374719a9f803/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:24:59.119435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.142509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.143493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.143835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.144243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/cdd044c2ea3248288976374719a9f803/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.146696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, user_id=cdd044c2ea3248288976374719a9f803, role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.148352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.170140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 66/132] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:24:58 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/cdd044c2ea3248288976374719a9f803/roles/0b454d4febc34038bd35eda57f52340d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:24:59.171996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.328730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2e28c-547e-4bcc-b3a8-336495da6a16 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.368692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872547-d55f-4467-855e-1030364c8092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.369717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872547-d55f-4467-855e-1030364c8092 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.369955 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872547-d55f-4467-855e-1030364c8092 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.370235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872547-d55f-4467-855e-1030364c8092 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/3d67c7af6def40d481bce9d42fed2d4f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.372422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872547-d55f-4467-855e-1030364c8092 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, user_id=3d67c7af6def40d481bce9d42fed2d4f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.374588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872547-d55f-4467-855e-1030364c8092 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.381891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559caad-d86c-4925-ad81-931e4e660daf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.394901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 67/133] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:24:59 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/3d67c7af6def40d481bce9d42fed2d4f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:24:59.445570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.446316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.446613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.446950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.447816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:24:59.448187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.449593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.462376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 67/134] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:59.468705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872547-d55f-4467-855e-1030364c8092 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.606542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872547-d55f-4467-855e-1030364c8092 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.651046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.651959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.652311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.652523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.653788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.655956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.657800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 68/135] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:24:59 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:59.663388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.799687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7f94-ccd2-49dc-ac69-e05713c20d01 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:24:59.856069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:24:59.856976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:24:59.857836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:24:59.858209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] PATH_INFO: `/v3/projects/b695cb288d3546d992673990681be539` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:24:59.864484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] RBAC: Authorizing `identity:get_project(project_id=b695cb288d3546d992673990681be539)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:24:59.866664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736396f-f41a-458d-ad69-46ff1c0f45ae None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:24:59.868741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 68/136] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:24:59 2022] GET /identity/v3/projects/b695cb288d3546d992673990681be539 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:24:59.874379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:24:59.991440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e41b-050c-41f4-b8e9-96567f093167 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:00.037108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdc76-6d8f-4348-8a6e-79339a608882 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.037600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdc76-6d8f-4348-8a6e-79339a608882 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.037668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdc76-6d8f-4348-8a6e-79339a608882 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.039130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 69/137] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:00.039987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:00.040895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.041183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.041471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] PATH_INFO: `/v3/projects/b695cb288d3546d992673990681be539/users/cdd044c2ea3248288976374719a9f803/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.043496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b695cb288d3546d992673990681be539, user_id=cdd044c2ea3248288976374719a9f803, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:00.045118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea833f-7bc2-4dc3-9e0f-521dea7830c1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:00.057053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.057354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.057636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.078660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 69/138] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:24:59 2022] PUT /identity/v3/projects/b695cb288d3546d992673990681be539/users/cdd044c2ea3248288976374719a9f803/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:00.107523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:00.108734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:00.164183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648151-b843-42af-9b7d-81d584d2bb48 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.164496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648151-b843-42af-9b7d-81d584d2bb48 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.164805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648151-b843-42af-9b7d-81d584d2bb48 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.166306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 70/139] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:00.181128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.181480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.181892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.225298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:00.226623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:00.302052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 71/140] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:00.303190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 70/141] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:00.327636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:00.357914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:00.469454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774344-62fa-4ae3-868b-b72b5fab623f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:00.558072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c138a-79ac-4f6a-ac55-d0b98f54cd4b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:00.592648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:00.593470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.593943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.594044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.596812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:00.598299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:00.600008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 72/142] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:00.626537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:00.700107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:00.711299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.711299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.711299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.749404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:00.769823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:00.770709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:00.771473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 71/143] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:00.781860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:00.920916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d87ae1-fd95-4d4a-a765-c4a4e7d0b8e3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:00.961369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233626d-d6f9-4f0c-92c9-f145c6c08a37 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:00.996023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:00.997046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:00.997550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:00.998572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:00.999514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:01.001190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:01.024037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:01.025809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:01.026160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:01.026438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:01.028261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:01.028581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:01.030119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:01.040372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 72/144] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:01.042647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 73/145] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:00 2022] POST /identity/v3/users => generated 283 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:01.053443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:01.238667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da29b10-a8e9-4103-b16e-782cec994e91 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:01.283597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:01.284543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:01.284800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:01.285079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] PATH_INFO: `/v3/users/d94c960723ea40a5abad35e3d3324857` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:01.286443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] RBAC: Authorizing `identity:get_user(user_id=d94c960723ea40a5abad35e3d3324857)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:01.291288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:01.291718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 73/146] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:01 2022] GET /identity/v3/users/d94c960723ea40a5abad35e3d3324857 => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:01.299565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:01.487106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45114-57be-49f1-bac0-4a6c83ef049c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:01.564001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:01.564874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:01.565158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:01.565436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:01.566664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:01.568438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71cfc9-e424-4b3b-9ead-d163ba0ce877 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:01.570171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 74/147] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:01 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:01.576665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:01.699594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68838d81-ca8e-495b-a3d6-bdde30b1b06f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:01.737088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:01.738001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:01.739349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:01.739349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/d94c960723ea40a5abad35e3d3324857/roles/bf63f7b41559454a964448f2cc159a20` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:01.740586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, user_id=d94c960723ea40a5abad35e3d3324857, role_id=bf63f7b41559454a964448f2cc159a20)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:01.742060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8b56-5af8-434a-9989-9c62c5a5eb6d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:01.761205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 74/148] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:01 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/users/d94c960723ea40a5abad35e3d3324857/roles/bf63f7b41559454a964448f2cc159a20 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:02.905741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3ae1-8153-4941-8cd1-0ebfdaf0a792 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:02.906262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3ae1-8153-4941-8cd1-0ebfdaf0a792 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:02.906334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e3ae1-8153-4941-8cd1-0ebfdaf0a792 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:02.907721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 75/149] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:02.923594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:02.924082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:02.924153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:02.941232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:02.942680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:02.978366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e37dd-a3ed-4c8b-9306-270ffe11087c None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:02.978654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e37dd-a3ed-4c8b-9306-270ffe11087c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:02.978926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e37dd-a3ed-4c8b-9306-270ffe11087c None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:02.980399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 76/150] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:02.985419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:02.985710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:02.985994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.007885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:03.009088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:03.077404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 75/151] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:03.116327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 77/152] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:03.122123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.151205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.310929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dd4a8-93a7-4c94-8d50-a5e9c2a86c2b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.345417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904b46-a18f-4e2f-9bf4-1503213db172 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.350764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.351617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.351901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.352174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.368120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9e16c533-fd01-4cb4-87b2-98c1368cc05b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:03.385215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:03.386172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:03.386918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 76/153] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:03.388061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9915e5-c6fa-418a-a409-4e22c26d2c7e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.388061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9915e5-c6fa-418a-a409-4e22c26d2c7e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.388364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9915e5-c6fa-418a-a409-4e22c26d2c7e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.390114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 77/154] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:03.396331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.396623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.396914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.435644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.435644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.435644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.435644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.440418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:03.441628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:03.456602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:03.472453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:03.473324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:03.474057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 78/155] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:03.475160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.581489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369404-4a18-423e-a3b3-e0a6f9c2039d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.604959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 78/156] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:03.605915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.623801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.624474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.624755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.625028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.625780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:03.626084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:03.627835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:03.646641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 79/157] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:03.654564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.789373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dfd3-277d-460d-84f7-9dad2598a1ff None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.797149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307876d-f024-4d86-bca5-b8fb40296923 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.833953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.835630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.836107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.836567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.837984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:03.839670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:03.841995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 80/158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:03.843293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.880867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.881553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.881838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.882120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.882871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:03.883190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:03.884611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423636d-e05b-4e11-be0e-b9531d1bc169 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:03.902754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 79/159] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:03.904193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672afc48-3a14-4578-b662-f16df2e3513a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.904533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672afc48-3a14-4578-b662-f16df2e3513a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.904753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672afc48-3a14-4578-b662-f16df2e3513a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:03.906121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 80/160] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:03.906807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672afc48-3a14-4578-b662-f16df2e3513a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:03.954128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75b16b-6521-4adc-9ee5-485abdb9afed None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:03.989366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:03.990586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:03.991085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:03.991629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.003317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:04.017822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:04.018695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:04.019664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:04.022174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 81/161] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:04.023165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.045474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672afc48-3a14-4578-b662-f16df2e3513a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.108395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:04.108981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.109260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.109528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.134574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee23b-8828-4896-bb99-070db84a0999 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.169965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:04.171237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.171911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.172420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] PATH_INFO: `/v3/users/3d67c7af6def40d481bce9d42fed2d4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.173848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] RBAC: Authorizing `identity:get_user(user_id=3d67c7af6def40d481bce9d42fed2d4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:04.175579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141627a-fd02-4650-b058-b268bf14cb41 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:04.177859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 82/162] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/users/3d67c7af6def40d481bce9d42fed2d4f => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:04.179325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.179803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.180269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.193823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:04.195375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:04.199330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:04.200729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:04.276954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 83/163] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:04.278386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.385219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdd0f6-5cd0-4bf5-be6e-c95beab977f3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.386620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 81/164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:04.387507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.472474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:04.473150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.473430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.473703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.474452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:04.474756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:04.476183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:04.499554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 84/165] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:04.500416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.631418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c89fc-f1cc-4777-a2b6-eea0b21c1384 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.688120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:04.688694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.688986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.689250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.718813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bfa31-6323-4786-80d4-6bbd537238e9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.757096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:04.758574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:04.785328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:04.786469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:04.786942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:04.787506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:04.806093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:04.819331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:04.820301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:04.821082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 85/166] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:04.821763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.858771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 82/167] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:04.859645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:04.988644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1db5-8baf-4af3-b24e-817d25aa633e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:04.999545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f4ba-d6d4-4f34-9556-55e3ff6683af None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.026434 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.028060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.028355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.028631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.030554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.032033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.036090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 83/168] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.036904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.069589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.070859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.071383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.071914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.075571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.077913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.084271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 86/169] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:04 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.085391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.140601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21941c99-eb6b-4bb8-84a0-8aa49a93b268 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.174679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.175382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.175663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.175938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.176689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:05.177652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.178476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.187319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 84/170] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.188045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.251879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950a79-a017-4c1f-992d-0096fe25cbad None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.288816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc66e-2bc2-4ce4-9ccf-fe1eb9a56206 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.321731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.322604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.322887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.323175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.326383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.327880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.329758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 87/171] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.330359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.345189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.345846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.346127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.346399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.415448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.418042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.577870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc88cb-4f02-4ea2-ac53-74f71fd458c6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.611924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 85/172] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:05.612869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.634795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.635496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.635779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.636055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.636899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:05.637211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.638709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.652520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 88/173] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=0b454d4febc34038bd35eda57f52340d => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.653360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.778066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403a8b4-ac5c-4659-8eef-cfc4efff1f6c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.786535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c953a-6fd2-4e12-ab17-11ee786a1a26 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.813871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.814478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.814761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.815034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.815927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=3d67c7af6def40d481bce9d42fed2d4f) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:05.816208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.817938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.823943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 89/174] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/role_assignments?user.id=3d67c7af6def40d481bce9d42fed2d4f&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.824765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.832408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.833797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.834979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.835565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] PATH_INFO: `/v3/users/cdd044c2ea3248288976374719a9f803` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.837734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd044c2ea3248288976374719a9f803)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.840216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849968-e652-410b-b737-ebd9b97fc429 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.843343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 86/175] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/users/cdd044c2ea3248288976374719a9f803 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.844882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df8ad-808c-4f28-a172-0ae53074abe0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.845378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df8ad-808c-4f28-a172-0ae53074abe0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.845861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df8ad-808c-4f28-a172-0ae53074abe0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.847572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 87/176] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:05.849458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f49d-1cf8-4742-93bf-71261f4eb018 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.849988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f49d-1cf8-4742-93bf-71261f4eb018 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.850629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f49d-1cf8-4742-93bf-71261f4eb018 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.852969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 88/177] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:05.853964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f49d-1cf8-4742-93bf-71261f4eb018 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:05.945202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bfbcf-ea81-4714-a392-2a865f9a4f29 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.981533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f49d-1cf8-4742-93bf-71261f4eb018 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:05.983010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:05.984095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.984477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.985774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:05.986473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:05.988093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521021b-66c0-42b3-a867-873fc6bb4059 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:05.990049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 90/178] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:05.991690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b03728-5f4f-441a-8b30-5b7927e0ba0d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:05.992548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b03728-5f4f-441a-8b30-5b7927e0ba0d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:05.992548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b03728-5f4f-441a-8b30-5b7927e0ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.009666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b6b03728-5f4f-441a-8b30-5b7927e0ba0d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:06.011140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b6b03728-5f4f-441a-8b30-5b7927e0ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:06.021926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.022885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.023359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.023786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.085646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 91/179] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:06.087130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.087711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.087926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.097721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.099426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.107306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:06.107306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:06.179144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 92/180] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:06.180298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.222968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 89/181] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:06.228534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.291429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47a875-2b7d-404b-8bec-5f8b3835bf2a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.327909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.328575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.328853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.329127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.329970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:06.330278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.331754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.338465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 93/182] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=834e56c266a046559104d936315ca310 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:06.339000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.346445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e330-d162-44ca-9f54-4ba515525e82 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.393894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.394778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.395061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.395360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.407966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:06.416406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:06.417346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:06.418114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 90/183] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:06.418738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.463388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83ad99-0049-4465-bf9f-4c5c7f2f99a2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.500770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.501643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.501917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.502193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] PATH_INFO: `/v3/projects/b695cb288d3546d992673990681be539` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.503444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] RBAC: Authorizing `identity:get_project(project_id=b695cb288d3546d992673990681be539)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.504894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.506602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 94/184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/projects/b695cb288d3546d992673990681be539 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:06.507383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.553027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4657-7479-4b2e-a037-9ae4594c1fc1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.593129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.594284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.594782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.595248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.607309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:06.615294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1723c6-2e08-48bf-8700-d2ef42c58756 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:06.616149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:06.617009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:06.617769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:06.620382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 91/185] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:06.621443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.658306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.658987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.659276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.659556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.660305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:06.660606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.661980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6132-1fe8-4264-a1dd-3437f264848d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.671199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 95/186] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:06.672574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3781b-2484-4591-88b7-1e79390653fd None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.672858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3781b-2484-4591-88b7-1e79390653fd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.673206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3781b-2484-4591-88b7-1e79390653fd None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.674356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 96/187] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:06.675033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3781b-2484-4591-88b7-1e79390653fd None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.738749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416321-ea09-4392-9e1a-850762d7205c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.776331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.776998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.777281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.777553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.778389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=b695cb288d3546d992673990681be539, user.id=cdd044c2ea3248288976374719a9f803) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:06.778769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.780842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2b37e-d996-4dfb-872e-9a3a33a92f1e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.786624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 92/188] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/role_assignments?user.id=cdd044c2ea3248288976374719a9f803&scope.project.id=b695cb288d3546d992673990681be539&role.id=834e56c266a046559104d936315ca310 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:06.787519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3781b-2484-4591-88b7-1e79390653fd None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.787965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c299-ea73-4cf0-ad35-ee326136d80a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.788237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c299-ea73-4cf0-ad35-ee326136d80a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.788571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c299-ea73-4cf0-ad35-ee326136d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.807250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c1e0c299-ea73-4cf0-ad35-ee326136d80a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:06.808544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c1e0c299-ea73-4cf0-ad35-ee326136d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:06.824748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.825438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.826261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.826547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.827329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:06.827642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:06.829068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:06.838219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 97/189] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:06.838219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.886921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 93/190] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:06.888785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402318a-2938-4e9f-9d7f-392035f667a7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.889073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402318a-2938-4e9f-9d7f-392035f667a7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.889344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402318a-2938-4e9f-9d7f-392035f667a7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:06.890743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 94/191] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:06.895371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402318a-2938-4e9f-9d7f-392035f667a7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:06.953733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8469f3-9157-4ab0-9299-8c5532f48ff9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:06.990354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:06.991292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:06.991569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:06.991847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.005599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.007061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21989d3-25f1-4f2c-95fc-e490c63c77b1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.007429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402318a-2938-4e9f-9d7f-392035f667a7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.008963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 98/192] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.010013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.010540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.010540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.029426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:07.031557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:07.047173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.048095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.048377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.048653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] PATH_INFO: `/v3/users/d94c960723ea40a5abad35e3d3324857` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.049850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] RBAC: Authorizing `identity:get_user(user_id=d94c960723ea40a5abad35e3d3324857)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.051304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.052936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 95/193] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:06 2022] GET /identity/v3/users/d94c960723ea40a5abad35e3d3324857 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.053775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.094730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 99/194] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:07.096224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.150947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0c66-1c27-405d-a52e-c4f496f5678d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.181543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.182332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.182607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.182870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.187167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4a6b7-eca3-46c7-82db-e3af1c533a89 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.193173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:07.201730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:07.202564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:07.203615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 96/195] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:07.204252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.224303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.224943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.225220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.225492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.287786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.289242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.294514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08017946-dcf4-4806-b16a-0adb98ee6bc0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.326468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.327102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.327403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.327673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.380112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 100/196] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:07.384948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.390119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.391589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.476371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06c69-5990-4ceb-b45b-707ada56f2f8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.483256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 97/197] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:07.483256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.512896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.514252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.514523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.514791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.515976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.517418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.519024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 101/198] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.520117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.576230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3611-d7bb-4a58-ad1f-cd428a1fe372 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.607714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.608374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.608656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.608929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.609667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:07.609970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.610764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a9f9-a899-4a96-8634-90da93f6f671 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.611367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.618860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 98/199] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.619670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.642802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.643693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.643970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.644238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.645397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.646820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.648530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 102/200] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.649257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.712287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393f56-c1ad-4b86-b865-8fbcd439bbcf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.740118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5339d03-4c7d-4948-80b3-8d8cdd3e3e52 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.745074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.745930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.746205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.746473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.747698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.749127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.750809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 99/201] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.752509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.772152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.772816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.773094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.773367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.774074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.775533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.793422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 103/202] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:07 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:07.794209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.868881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b0d4-d63d-4b5b-8b0b-61427ecce211 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.900857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ecff-2048-4508-ba04-494b9caec8b7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:07.905160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.906190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.906570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.906941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.908344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.909927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.916263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 100/203] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.916263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:07.942213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:07.943141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:07.943451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:07.943726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:07.944573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=067bd9e818c94717b0a348c06628391e) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:07.944882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:07.946378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:07.963051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 104/204] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/role_assignments?user.id=067bd9e818c94717b0a348c06628391e&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:07.963051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:08.023287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5ace-9cf0-4203-8649-18e6a029bd5f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:08.059259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:08.059962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:08.060786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:08.061062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:08.061923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d, user.id=d94c960723ea40a5abad35e3d3324857) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:08.062235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:08.063765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:08.070817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 101/205] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/role_assignments?user.id=d94c960723ea40a5abad35e3d3324857&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=bf63f7b41559454a964448f2cc159a20 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:08.074077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0d84-0169-46c6-bade-30cc310f0abb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:08.114399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:08.115076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:08.115420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:08.115701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:08.201811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:08.203362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:08.308332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 105/206] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:08.314492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:08.426922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989fdb-b0c5-42fd-9101-1419c3920a7d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:08.461453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:08.462327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:08.462609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:08.462885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:08.464126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:08.465627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56cc90-5640-41f4-8840-b3f6c6e53052 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:08.467449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 102/207] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:08 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:08.473428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:08.592401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4d70-5a1b-48fb-978b-50ccdc1e36f5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:08.629045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:08.629703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:08.629980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:08.630250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:08.631081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=067bd9e818c94717b0a348c06628391e) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:08.631421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:08.632863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9b86-877a-4be4-89b6-b7403702a603 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:08.638625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 106/208] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:08 2022] GET /identity/v3/role_assignments?user.id=067bd9e818c94717b0a348c06628391e&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=0b454d4febc34038bd35eda57f52340d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:10.292129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c760-e478-48b2-bd1e-e2dc910bc7ea None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.292638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c760-e478-48b2-bd1e-e2dc910bc7ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.292713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c760-e478-48b2-bd1e-e2dc910bc7ea None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.294191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 103/209] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:10.299117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194adb-8de4-4098-b448-e900e3837139 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.299595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194adb-8de4-4098-b448-e900e3837139 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.299770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194adb-8de4-4098-b448-e900e3837139 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.301195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 107/210] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:10.303651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04adc8-5031-480a-94c1-011bb38f9a34 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.303935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04adc8-5031-480a-94c1-011bb38f9a34 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.304211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04adc8-5031-480a-94c1-011bb38f9a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.307369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5067ce-bbd5-4a66-a73d-ed4b2639fbed None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.307656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5067ce-bbd5-4a66-a73d-ed4b2639fbed None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.307935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5067ce-bbd5-4a66-a73d-ed4b2639fbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.321637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1c04adc8-5031-480a-94c1-011bb38f9a34 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:10.322947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1c04adc8-5031-480a-94c1-011bb38f9a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:10.324635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ac5067ce-bbd5-4a66-a73d-ed4b2639fbed None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:10.325824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ac5067ce-bbd5-4a66-a73d-ed4b2639fbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:10.393087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 104/211] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:10.394136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 108/212] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:10.407023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d453-0092-43d0-ba94-657462721a77 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.407327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d453-0092-43d0-ba94-657462721a77 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.407608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d453-0092-43d0-ba94-657462721a77 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.409239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 105/213] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:10.414589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.414873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.415143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.418315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288d453-0092-43d0-ba94-657462721a77 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.434708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:10.435952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:10.500903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 109/214] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:10.508215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.521666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288d453-0092-43d0-ba94-657462721a77 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.556929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.558037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.558518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.559430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.570484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:10.578789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:10.579700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 106/215] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:10.583991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.609717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a6e68-3733-49e3-b7cc-2cf81c72718b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.642611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.643463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.643743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.644012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.656948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:10.664793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:10.665775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:10.666567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 110/216] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:10.668646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.679186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43e31-88e3-48ba-a162-94e5dbb53451 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.715009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.716239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.716733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.717067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.718348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:10.719837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:10.725839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 107/217] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:10.725839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.770509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc1ec-779e-467b-8c12-716d2c920f64 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.802867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.803564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.803843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.804113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.804846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:10.805146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:10.806564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:10.815394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 111/218] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:10.820518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.825428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5631a9-ca9a-4bab-a603-933abbde0e68 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.862996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.863695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.863977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.864246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.864984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:10.865286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:10.866642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:10.874879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 108/219] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:10.874879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.913951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc40c-7b6d-4f95-a19f-394b3b467676 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:10.944885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:10.945539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.945813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.946078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.946777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:10.948231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cb156-aa81-4ef6-98ab-f4f4ee8b973f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 112/220] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:10 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b249c-baa2-497a-8716-f549afe292d8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b249c-baa2-497a-8716-f549afe292d8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b249c-baa2-497a-8716-f549afe292d8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 113/221] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:10.975305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b249c-baa2-497a-8716-f549afe292d8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:10.985108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5ce8-430f-43a7-876c-edd9027dc07c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.020612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.021516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.021792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.022062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] PATH_INFO: `/v3/users/d3d529ce9d5d424cb32cd562f4617b80` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.036876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d529ce9d5d424cb32cd562f4617b80)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.038357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0a8c-3afd-479f-b364-e0fa175298c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.040204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 109/222] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/users/d3d529ce9d5d424cb32cd562f4617b80 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.040204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.040204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.040204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.060848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:11.062050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:11.084564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b249c-baa2-497a-8716-f549afe292d8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.120063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.120998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.121274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.121595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.122893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.124452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.126275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 114/223] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:10 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.127033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.134898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 110/224] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:11.136403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.236758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429fbdd-cebd-415c-8723-f1a15d62c54b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.244617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add828bd-3fc2-4a84-9535-854e27e9088a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.276225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.277211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.277692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.278200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.282934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.283861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.284996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.285274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.286501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.288068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.289802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 111/225] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.291055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.350327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.351743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.391435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983964-d00c-4c84-9f82-3932aa3786b0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.433346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.434171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.434447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.434714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.445772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:11.452519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 115/226] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:11.453410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:11.454455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:11.455326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:11.456113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 112/227] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:11.463188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.552258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e771-18e6-4b58-8887-161a80d81022 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.587554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.588438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.588712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.588969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/067bd9e818c94717b0a348c06628391e/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.589342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddc1-1add-4fd5-bb6f-ad94f779e676 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.590912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, user_id=067bd9e818c94717b0a348c06628391e, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.592445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.606071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 116/228] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:11 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/067bd9e818c94717b0a348c06628391e/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:11.608520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.650753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.651910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.652409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.652875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.653876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:11.654387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.656068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.668972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 113/229] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.674642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.740409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bd404-49e5-4042-96ed-a997ee3dc6ad None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.780986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.782306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.782783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.783249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.784819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.786511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.788544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 117/230] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.800365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.837276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10092b0-362d-4f98-9c83-3a3b8667e3a2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.873063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.874104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.874389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.874659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.875905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.877359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.879058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 114/231] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:11.884483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:11.910986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7070-2585-43f2-a82a-fbaac6d1399d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:11.946101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:11.947114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:11.947633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:11.948097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:11.949164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=d3d529ce9d5d424cb32cd562f4617b80) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:11.949695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:11.951991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:11.957904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 118/232] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/role_assignments?user.id=d3d529ce9d5d424cb32cd562f4617b80&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=834e56c266a046559104d936315ca310 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:11.993269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8433e-d8a8-4608-a7b2-da254a48c2b1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:12.031304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:12.032213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:12.032494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:12.032769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:12.034110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:12.035689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29c0b-30d6-49b5-81cd-01d2bd58f42f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:12.037864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 115/233] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:11 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:12.043616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:12.156490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa33a83-0c3c-43e2-964a-2b841b31dd91 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:12.206004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:12.206917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:12.207192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:12.207505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/067bd9e818c94717b0a348c06628391e/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:12.209707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, user_id=067bd9e818c94717b0a348c06628391e, role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:12.211159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4cfd-ac15-4097-aba4-7950ef5e4422 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:12.234454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 119/234] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:12 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/067bd9e818c94717b0a348c06628391e/roles/0b454d4febc34038bd35eda57f52340d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:13.796674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ffd51-827c-4747-8914-610e75d5ff0c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:13.797150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ffd51-827c-4747-8914-610e75d5ff0c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:13.797150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ffd51-827c-4747-8914-610e75d5ff0c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:13.798770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 116/235] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:13.804411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:13.804869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:13.804944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:13.808598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911222a-d281-46ee-b10f-088707202f65 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:13.808881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911222a-d281-46ee-b10f-088707202f65 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:13.809149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911222a-d281-46ee-b10f-088707202f65 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:13.811160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 117/236] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:13.815953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:13.816231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:13.816502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:13.846263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:13.847465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:13.850301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:13.851469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:13.962872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 118/237] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:13.979320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 120/238] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:13.986000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.020506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.085654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acffe6-9f42-4688-ad66-e25a1f607708 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.119410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.120211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.120490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.120762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.131845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:14.140451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:14.141326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:14.142092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 119/239] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:14.147155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.251397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270fac5-1f85-4590-b086-cee7aac047a3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.257343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff59d5-739b-41f4-aa7e-46d56ee2c685 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.301694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.302367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.302645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.302919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.303689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:14.303993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:14.305379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:14.325287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 120/240] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:14.328212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.329058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.329366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.329637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.330991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.331966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:14.333425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:14.335038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 121/241] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:14.345808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.471994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd11b-6903-45d8-8027-d220f7748e29 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.513833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ba251-e829-401b-82c8-9235f0d4de1e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.514565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.515860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.516527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.517875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] PATH_INFO: `/v3/users/8f42f6d4b7d441e69234773980bc94fd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.536722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] RBAC: Authorizing `identity:get_user(user_id=8f42f6d4b7d441e69234773980bc94fd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:14.538870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc093d30-9f89-44f0-a7fa-df3599bc7129 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:14.541593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 121/242] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/users/8f42f6d4b7d441e69234773980bc94fd => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:14.543732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46610dd-e2f6-4427-8641-2609d61207a1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.544329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46610dd-e2f6-4427-8641-2609d61207a1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.544754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46610dd-e2f6-4427-8641-2609d61207a1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.546808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 122/243] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:14.547747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46610dd-e2f6-4427-8641-2609d61207a1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.551068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.553893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.554685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.555402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.556643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:14.558309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72269b24-324f-4ef5-8c8e-ba3a6ea65551 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:14.590819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 122/244] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:14 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:14.592811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.593232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.593750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.616501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:14.618745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:14.680583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46610dd-e2f6-4427-8641-2609d61207a1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.723797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.724754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.725136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.725514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.726796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 123/245] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:14.768642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.851224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:14.852745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43bcfe-dd07-4133-a98a-7263b2cc405f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:14.911098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9176a-b37e-4cfb-913c-11642ad5a7ef None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:14.964390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:14.965195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.966377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.966377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.977457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-72fbeb07-9a04-4659-b982-4498df1c8ac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:14.986002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:14.987024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:14.987927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 124/246] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:14.988561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd63b-75a5-48a5-b3e8-9274d1d17da2 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.988737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd63b-75a5-48a5-b3e8-9274d1d17da2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.989007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fd63b-75a5-48a5-b3e8-9274d1d17da2 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:14.990519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 125/247] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:14.993556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 123/248] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:14.995311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fd63b-75a5-48a5-b3e8-9274d1d17da2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:14.995803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:14.996148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:14.996354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.024115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:15.025757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:15.111291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 124/249] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:15.111291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.145083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fd63b-75a5-48a5-b3e8-9274d1d17da2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.196781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.197743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.198035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.198309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.199065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:15.203397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.203397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520b32d-b99c-4f27-93f5-a0c90c7d29d8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.212760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 126/250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:15.215055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eacd5-129a-4543-9307-8e31dfe3a865 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.217628 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eacd5-129a-4543-9307-8e31dfe3a865 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.218009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eacd5-129a-4543-9307-8e31dfe3a865 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.220358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 127/251] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:15.221513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eacd5-129a-4543-9307-8e31dfe3a865 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.238888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302214-406a-40fc-8a59-657b3ea9d042 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.283700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.284979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.285354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.285723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.287459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.289001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.290817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 125/252] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:15.292283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.346287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eacd5-129a-4543-9307-8e31dfe3a865 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.383156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.384099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.384517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.384883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.396061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-316c55dd-2c0d-401a-98a7-0b0bb2b74c1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:15.405136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:15.406251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:15.407351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:15.412639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 128/253] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:15.414243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.414608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.414902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.433849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:15.435938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:15.436673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2b1e-346f-46d7-9628-c53b40aa74cc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.472758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.473844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.474278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.474690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.476092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.477699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.479540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 126/254] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:15.480518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.515416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 129/255] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:15.516636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.615364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00463-8552-41cb-a4e8-4a86df79c41f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.642840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb9d7-7095-469b-87f1-a4ef37580bdd None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.656084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.656745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.657022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.657296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.658375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=8f42f6d4b7d441e69234773980bc94fd) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:15.659030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.660745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.667961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 127/256] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/role_assignments?user.id=8f42f6d4b7d441e69234773980bc94fd&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=bf63f7b41559454a964448f2cc159a20 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:15.669032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.680393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.681449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.681934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.682412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.683437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:15.683939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.685531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.694920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 130/257] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:15.696143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:15.800197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c361bb3-7fa6-4359-86de-c21ab6c61b55 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.827491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234201-07de-4b52-9cac-fb31be9e62d9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:15.845204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.847522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.848776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.849439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.896665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:15.897932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:15.898446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:15.898919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:15.924224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:15.930660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:15.932135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:15.939287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:15.940182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:15.940972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:15.941567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 131/258] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:15.942106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.081582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 128/259] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:16.082387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.141352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8ecf-e3f4-4ccd-b5c2-59400260fdfa None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.209626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d99ca-fb6c-48d0-a666-8e901fdd2705 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.224480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.225366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.225645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.225915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] PATH_INFO: `/v3/users/d3d529ce9d5d424cb32cd562f4617b80` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.232011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] RBAC: Authorizing `identity:get_user(user_id=d3d529ce9d5d424cb32cd562f4617b80)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.233493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.235465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 132/260] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:15 2022] GET /identity/v3/users/d3d529ce9d5d424cb32cd562f4617b80 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.236225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.243860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.244600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.244885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.245159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.245916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:16.246218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.248121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.257693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 129/261] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.258482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.369647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8218f1-2978-4228-8216-45546e30ef48 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.414281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.415151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.415469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.415744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.417085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.418539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.420792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 130/262] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.421551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.470214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8b74-87ce-406e-a620-ec2d0bee859b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.530606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96fae-39f7-4246-8b63-7be0945e1a43 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.535933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.536807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.537088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.537362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.538570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.540050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.541745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 133/263] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.542546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.570569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.571674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.571944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.572222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] PATH_INFO: `/v3/users/067bd9e818c94717b0a348c06628391e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.573581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] RBAC: Authorizing `identity:get_user(user_id=067bd9e818c94717b0a348c06628391e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.575082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.577343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 131/264] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/users/067bd9e818c94717b0a348c06628391e => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.578335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.690022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91458-75a2-4d1c-a283-c02487023959 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.755878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.756534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.756809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.757078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.757908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=067bd9e818c94717b0a348c06628391e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:16.758212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.759677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.763246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff19d-9ad7-47ae-8805-39e1730fca09 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.773825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 132/265] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/role_assignments?user.id=067bd9e818c94717b0a348c06628391e&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:16.776346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:16.832810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.833713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.833992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.834257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/d3d529ce9d5d424cb32cd562f4617b80/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:16.837424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, user_id=d3d529ce9d5d424cb32cd562f4617b80, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:16.839887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:16.874029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 134/266] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:16 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/d3d529ce9d5d424cb32cd562f4617b80/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:16.924031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030f1cc-b163-4e63-af43-d2a00a40284c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:16.961999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:16.963524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:16.964030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:16.964509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.056847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:17.058732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:17.185409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 133/267] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:17.191316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.340737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938b3f-13e5-43d0-bc0e-baae39b64b3d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.381575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:17.382444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.382719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.382989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.388596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:17.390078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd617efe-a301-4b19-a9e9-9a3ca321fd16 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:17.392179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 135/268] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:17 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:17.397933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.443458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a7221-9986-4f75-82a5-7919a542d8c8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.443742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a7221-9986-4f75-82a5-7919a542d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.444103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a7221-9986-4f75-82a5-7919a542d8c8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.445604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 136/269] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:17.452209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8ab2-50a3-41f4-9577-efdad570bd60 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.452775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8ab2-50a3-41f4-9577-efdad570bd60 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.453278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8ab2-50a3-41f4-9577-efdad570bd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.472290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8d7f8ab2-50a3-41f4-9577-efdad570bd60 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:17.473822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8d7f8ab2-50a3-41f4-9577-efdad570bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:17.549042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 137/270] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:17.550710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c385-ad72-4d1c-bd93-ff9323c73309 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.551209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c385-ad72-4d1c-bd93-ff9323c73309 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.551740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c385-ad72-4d1c-bd93-ff9323c73309 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.553560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 138/271] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:17.567256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.567824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.568100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.586053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:17.587022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536b781-bdfb-4719-9903-b74f5a728e80 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.587208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:17.621947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:17.623213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.623530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.623805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.624703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=067bd9e818c94717b0a348c06628391e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:17.625013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:17.626503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:17.632980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 134/272] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:17 2022] GET /identity/v3/role_assignments?user.id=067bd9e818c94717b0a348c06628391e&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=0b454d4febc34038bd35eda57f52340d => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:17.633847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.656093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 139/273] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:17.680734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.746213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2f7a-0a93-4c11-a51b-3bf4f5f4948e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.780967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13065ead-c26f-4bd5-81e0-642299e17285 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.781191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:17.781923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.782206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.782480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.793578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:17.802491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:17.803397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:17.804187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 135/274] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:17.812880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.819440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:17.820255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.820530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.820801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.821981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:17.823470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:17.831414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 140/275] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:17.832766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:17.947017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef69eb-97c4-46d5-80c5-ef9c986898f0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.977574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257fad-84e1-4ab1-b906-ecf2a0497bca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:17.982575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:17.983350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:17.983698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:17.984035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:17.984811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:17.986339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:18.016299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 141/276] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:17 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:25:18.019804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:18.020708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.021187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.021642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.022612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:18.023086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:18.024730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:18.036603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 136/277] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:18.042259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:18.160744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449153c-fa3e-42da-b122-2208a1961f31 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:18.218934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:18.220603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.221065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.221540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] PATH_INFO: `/v3/users/3ed37dd25a9143f2b89e7c238912b9d2` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.241035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed37dd25a9143f2b89e7c238912b9d2)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:18.242918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b8cd-d908-4340-854f-10a13437ef93 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:18.245319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 142/278] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:18 2022] GET /identity/v3/users/3ed37dd25a9143f2b89e7c238912b9d2 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:18.251008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:18.354498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c24ed-f063-480a-ba45-636591744759 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:18.391231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:18.392203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.392661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.393109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.394137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, user.id=3ed37dd25a9143f2b89e7c238912b9d2, scope.system=all) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:18.394449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:18.395912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7759837-ec34-45fe-ba53-8f8602467726 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:18.403558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 137/279] 10.222.0.64 () {56 vars in 1308 bytes} [Wed May 11 06:25:18 2022] GET /identity/v3/role_assignments?user.id=3ed37dd25a9143f2b89e7c238912b9d2&scope.system=all&role.id=834e56c266a046559104d936315ca310 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:18.546592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104b68-89ec-4813-91a9-aae15910055d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.546887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104b68-89ec-4813-91a9-aae15910055d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.547067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104b68-89ec-4813-91a9-aae15910055d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.548500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 143/280] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:18.556394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.556394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.556394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.577098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:18.578723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:18.653322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 138/281] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:18.692204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104b68-89ec-4813-91a9-aae15910055d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:18.827190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104b68-89ec-4813-91a9-aae15910055d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:18.863942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:18.864737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:18.865011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:18.865279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:18.881675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:18.889571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:18.890422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:18.891601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 144/282] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:18.898095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:19.025176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975ed7-af45-4339-8ad7-450e8fba37a8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:19.066117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:19.067135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.067895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.068388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.069394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:19.069894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:19.071491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:19.080500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 139/283] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:19.086104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:19.236271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2dfe3-95cd-418a-8a3a-454bf8cad4dc None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:19.283174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:19.284067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.284344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.284614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] PATH_INFO: `/v3/users/8f42f6d4b7d441e69234773980bc94fd` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.285793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] RBAC: Authorizing `identity:get_user(user_id=8f42f6d4b7d441e69234773980bc94fd)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:19.287230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:19.289177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 145/284] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:19 2022] GET /identity/v3/users/8f42f6d4b7d441e69234773980bc94fd => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:19.294910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:19.462926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21dc17-1b9a-4afe-a8db-346721623912 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:19.510621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:19.511511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.511790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.512052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.513763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:19.515196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415c7f-3fca-4abe-ae47-9fa4e7bc31b2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:19.517210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 140/285] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:19 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:19.522522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:19.678448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3360c87-6af9-4184-8d48-8e331851c133 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:19.726129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:19.726956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.727233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.727527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/8f42f6d4b7d441e69234773980bc94fd/roles/bf63f7b41559454a964448f2cc159a20` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.729507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, user_id=8f42f6d4b7d441e69234773980bc94fd, role_id=bf63f7b41559454a964448f2cc159a20)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:19.730973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c86345-635b-4333-b38d-c6fe12af9ee8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:19.756040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 146/286] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:19 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/users/8f42f6d4b7d441e69234773980bc94fd/roles/bf63f7b41559454a964448f2cc159a20 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:19.933066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0a3-76d1-453a-bf31-5a9f09f11598 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.933066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0a3-76d1-453a-bf31-5a9f09f11598 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.933066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0a3-76d1-453a-bf31-5a9f09f11598 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.933878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 141/287] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:19.945376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:19.945672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:19.945944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:19.964343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:19.965524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:20.051099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 147/288] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:20.086172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c0a3-76d1-453a-bf31-5a9f09f11598 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:20.213806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c0a3-76d1-453a-bf31-5a9f09f11598 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:20.261316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:20.262496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:20.263521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:20.263993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:20.284158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:20.292495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:20.293347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:20.294179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:20.296517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 142/289] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:20.302440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:20.483061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b390d-670b-47f5-bc11-676aea374317 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:20.529622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:20.530305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:20.530582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:20.530853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:20.531637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:20.531941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:20.533323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:20.546964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 148/290] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:20.551948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:20.695810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e091cbe-9184-4582-8e2e-1ed8ca957b1c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:20.742423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:20.743677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:20.744154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:20.744620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] PATH_INFO: `/v3/users/d3d529ce9d5d424cb32cd562f4617b80` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:20.748375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d529ce9d5d424cb32cd562f4617b80)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:20.750053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ccd60-30cd-4e29-be59-deca146c1912 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:20.751940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 143/291] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:20 2022] GET /identity/v3/users/d3d529ce9d5d424cb32cd562f4617b80 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:20.757604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:20.885183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2987f-cbaf-4751-b6b6-c53a92f8e8ec None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:20.921363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:20.922060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:20.922339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:20.922607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:20.994148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54771-c892-45ce-95b0-baf99d6bca2b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:20.994762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54771-c892-45ce-95b0-baf99d6bca2b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:20.994953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:20.995459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a54771-c892-45ce-95b0-baf99d6bca2b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:20.996537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76d9c4-7730-4a00-ba9d-f97f1aa125b9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.001768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 144/292] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:21.003622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b637-fdf7-4264-8941-6bdfe4e3705c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.004109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b637-fdf7-4264-8941-6bdfe4e3705c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.004573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b637-fdf7-4264-8941-6bdfe4e3705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.039472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0ed9b637-fdf7-4264-8941-6bdfe4e3705c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:21.040900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0ed9b637-fdf7-4264-8941-6bdfe4e3705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:21.094885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 149/293] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:21.096470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54c-8840-4302-b926-91acf2bbd426 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.096912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54c-8840-4302-b926-91acf2bbd426 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.097319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54c-8840-4302-b926-91acf2bbd426 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.098703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 150/294] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:21.101025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b54c-8840-4302-b926-91acf2bbd426 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.124745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 145/295] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:21.126201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.126491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.126763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.151619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:21.152861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:21.220665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b54c-8840-4302-b926-91acf2bbd426 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.229023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 146/296] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:21.230536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.258900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.259707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.259981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.260249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.261401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.262825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140138ab-9810-4416-a267-aa78cea4399f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.267613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 151/297] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:21.267613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260404-c47b-41b0-9696-c0bede327ee3 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.267613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260404-c47b-41b0-9696-c0bede327ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.267613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260404-c47b-41b0-9696-c0bede327ee3 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.267613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 152/298] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:21.271545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab260404-c47b-41b0-9696-c0bede327ee3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.333597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b264298-a173-4027-aabe-53350a05e3a6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.366392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.367175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.367483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.367741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.369011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab260404-c47b-41b0-9696-c0bede327ee3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.377721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:21.385404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:21.386273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:21.387063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:21.391541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 147/299] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:21.392365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.405492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.406292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.406566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.406836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.408702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.410435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d2cc6-3425-4252-8711-2babe553788e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.413043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 153/300] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:21.413990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.414269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.414545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.437026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:21.438249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:21.500185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e549ed9-1fd1-41ec-a46a-0b8458641c90 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.507551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 154/301] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:21.508225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.538034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.538608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.538887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.539155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.540014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=d3d529ce9d5d424cb32cd562f4617b80) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:21.540326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.541894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.548402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 148/302] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/role_assignments?user.id=d3d529ce9d5d424cb32cd562f4617b80&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=834e56c266a046559104d936315ca310 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:21.548972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.633503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c25c7a-0b9b-4388-a3da-8832a5b94109 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.661361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538d6d-f708-4aff-b298-777f64d02324 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.677482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.678726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.679567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.680060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.681038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:21.681564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.684036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.696527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.701575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.701575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.701575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] PATH_INFO: `/v3/groups` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.701575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.701575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.702566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 155/303] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:21.703727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.719164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 149/304] 10.222.0.64 () {60 vars in 1134 bytes} [Wed May 11 06:25:21 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:21.720654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.838564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e557-e729-41ed-af6c-d374f4d248b1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.857287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7289c-5cab-436e-a682-f56ee3bc962f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:21.894252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.895900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.896439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.896873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.905771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:21.906813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:21.907190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:21.907587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] PATH_INFO: `/v3/users/3ed37dd25a9143f2b89e7c238912b9d2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:21.908957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed37dd25a9143f2b89e7c238912b9d2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:21.911063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:21.913419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:21.913788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 150/305] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/users/3ed37dd25a9143f2b89e7c238912b9d2 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:21.919487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:21.923076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:21.923988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:21.924764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:21.926934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 156/306] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:21.935386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:22.038276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721246d-7a86-4f71-ad19-96681a343c47 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:22.043222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4ea6-2988-49d5-b0ae-c9c562d0196c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:22.072888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:22.073870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.074151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.074424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] PATH_INFO: `/v3/system/users/3ed37dd25a9143f2b89e7c238912b9d2/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.076705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ed37dd25a9143f2b89e7c238912b9d2, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:22.077585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:22.078074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:22.078259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.078525 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.078799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.079586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:22.079892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:22.081263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:22.087518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 151/307] 10.222.0.64 () {58 vars in 1334 bytes} [Wed May 11 06:25:21 2022] PUT /identity/v3/system/users/3ed37dd25a9143f2b89e7c238912b9d2/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:25:22.096887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 157/308] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:22.102613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:22.215336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7e89-9089-455a-b8d9-42e34b35f054 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:22.252532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:22.253423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.253702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.253973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] PATH_INFO: `/v3/users/d6ed7d9c3b5348ac861671d61915f19e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.269485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ed7d9c3b5348ac861671d61915f19e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:22.270969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734aaf-0a8f-4e2e-82d0-f32fa382d414 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:22.273185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 152/309] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:22 2022] GET /identity/v3/users/d6ed7d9c3b5348ac861671d61915f19e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:22.278917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:22.378718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614c0c9-f775-48c4-af95-730e87b97c0f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:22.421886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:22.422596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.422876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.423147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.424008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, user.id=d6ed7d9c3b5348ac861671d61915f19e, scope.system=all) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:22.424316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:22.425802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91273-986e-489c-92d1-77fcff0aca40 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:22.431467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 158/310] 10.222.0.64 () {56 vars in 1308 bytes} [Wed May 11 06:25:22 2022] GET /identity/v3/role_assignments?user.id=d6ed7d9c3b5348ac861671d61915f19e&scope.system=all&role.id=bf63f7b41559454a964448f2cc159a20 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:22.583159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69968a-4b32-46ca-9021-79614d755984 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.583589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69968a-4b32-46ca-9021-79614d755984 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.583767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69968a-4b32-46ca-9021-79614d755984 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.585447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 153/311] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:22.591074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.591384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.591658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.610991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:22.610991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:22.678990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 159/312] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:22.701740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69968a-4b32-46ca-9021-79614d755984 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:22.805090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69968a-4b32-46ca-9021-79614d755984 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:22.839351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:22.840150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:22.840431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:22.840702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:22.851389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:22.859677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:22.860527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:22.861308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 154/313] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:22.866474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:22.970157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b722af-4aa2-45d2-a1df-a2bc2752368c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:23.005275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:23.005970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:23.006339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:23.006614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:23.007469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:23.007777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:23.009185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:23.018483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 160/314] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:23.023561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:23.123688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd3445-45fb-4ea2-b638-31ba0a3a5fb8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:23.156699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:23.157566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:23.157841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:23.158110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] PATH_INFO: `/v3/users/8f42f6d4b7d441e69234773980bc94fd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:23.159304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] RBAC: Authorizing `identity:get_user(user_id=8f42f6d4b7d441e69234773980bc94fd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:23.160730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:23.162641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 155/315] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:23 2022] GET /identity/v3/users/8f42f6d4b7d441e69234773980bc94fd => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:23.168033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:23.271289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cfcf-c3b5-454a-9e83-147581090729 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:23.306204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:23.306854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:23.307133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:23.307439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:23.373779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:23.375243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:23.475291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:25:23.480340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:23.584164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1247-8ab4-43fe-8c9a-5529d5e620c3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:23.618012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:23.618866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:23.619142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:23.619445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:23.620613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:23.622026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d46ca6-5b0b-4b3a-9565-8ef76cb00268 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:23.624666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 156/317] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:23 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:23.630364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:23.727147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981683ff-7881-4ff3-958b-172c1fc7b2ee None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:23.765321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:23.765974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:23.766249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:23.766520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:23.767368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f, user.id=8f42f6d4b7d441e69234773980bc94fd) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:23.767676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:23.769116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21bfc-9740-4a63-bf96-6bbd7c1f1041 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:23.775416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 162/318] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:23 2022] GET /identity/v3/role_assignments?user.id=8f42f6d4b7d441e69234773980bc94fd&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=bf63f7b41559454a964448f2cc159a20 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:24.127077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4391-1528-41b5-a332-755ffe5470e7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.127463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4391-1528-41b5-a332-755ffe5470e7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.127653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4391-1528-41b5-a332-755ffe5470e7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.129062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 157/319] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:24.134148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.134441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.134717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.150906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:24.152093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:24.215508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 163/320] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:24.238020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4391-1528-41b5-a332-755ffe5470e7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.339140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4391-1528-41b5-a332-755ffe5470e7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:24.371610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:24.372431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.372710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.372979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.374120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:24.375588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1438495-d10f-44f1-91d5-8b1c2556e753 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:24.377398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 158/321] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:24.382712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.434348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8dbdd-b1e3-4f5d-a725-79c02183742f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.434668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8dbdd-b1e3-4f5d-a725-79c02183742f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.434948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8dbdd-b1e3-4f5d-a725-79c02183742f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.436485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 159/322] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:24.441223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.441516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.441794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.459507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:24.460690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:24.484276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa775e-89b5-49ed-be76-e2e0e009fdd3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:24.518247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:24.518933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.519213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.519510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] PATH_INFO: `/v3/groups` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.520232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:24.521713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6360f2-5f7e-4aed-a9d5-57b96c8b26ed None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:24.535321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 160/323] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:24.551558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 164/324] 10.222.0.64 () {60 vars in 1134 bytes} [Wed May 11 06:25:24 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:24.557700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.667598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1028b-e9bd-46e7-8a29-f1d69c477aaa None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:24.703161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:24.704016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.704297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.704567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.708505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c18-38e6-4d56-a13f-7e6cbf3a26c1 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.708790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c18-38e6-4d56-a13f-7e6cbf3a26c1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.709063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c18-38e6-4d56-a13f-7e6cbf3a26c1 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.710578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 165/325] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:24.715704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:24.716532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.716830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.717100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:24.724850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:24.725767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:24.726555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 161/326] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:24.731751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.735012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:24.736236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:24.817296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 166/327] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:24.834196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1185d-e305-4517-9eff-73c3f42c2b88 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:24.841727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.868730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:24.869918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.870235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.870467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:24.871529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:24.871836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:24.873773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:24.884685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 162/328] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:24.891557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:24.953496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220939e-7fc7-44da-8de9-af31574d1959 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:24.995004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:24.995852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:24.996129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:24.996404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.008862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7c61-dad6-478f-9f67-0affa9ae234f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:25.016213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:25.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:25.024869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:25.025656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:25.027463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 167/329] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:25.031887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:25.043932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:25.045104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:25.045373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:25.045643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] PATH_INFO: `/v3/users/3ed37dd25a9143f2b89e7c238912b9d2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.046865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed37dd25a9143f2b89e7c238912b9d2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:25.048347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:25.050282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 163/330] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:24 2022] GET /identity/v3/users/3ed37dd25a9143f2b89e7c238912b9d2 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:25.056520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:25.145679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39ec1-13c1-4529-8673-2d04afb41249 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:25.157493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aa07b-ddbd-43cf-ab91-a82589402591 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:25.178918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:25.183134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:25.183449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:25.183734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.184521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:25.185333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:25.186751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:25.197249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:25.197916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:25.198194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:25.198469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.199366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] RBAC: Adding query filter params (role.id=834e56c266a046559104d936315ca310, user.id=3ed37dd25a9143f2b89e7c238912b9d2, scope.system=all) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:25.199679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:25.202438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 168/331] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:25.203963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:25.210279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:25.217669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 164/332] 10.222.0.64 () {56 vars in 1308 bytes} [Wed May 11 06:25:25 2022] GET /identity/v3/role_assignments?user.id=3ed37dd25a9143f2b89e7c238912b9d2&scope.system=all&role.id=834e56c266a046559104d936315ca310 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:25.342346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e7477-53bf-40f5-a27a-7accc20c834a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:25.383749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:25.384645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:25.384915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:25.385180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] PATH_INFO: `/v3/users/d6ed7d9c3b5348ac861671d61915f19e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.386437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ed7d9c3b5348ac861671d61915f19e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:25.388615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a934a-9373-4289-9aa1-8be666f122a8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:25.391661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 169/333] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:25 2022] GET /identity/v3/users/d6ed7d9c3b5348ac861671d61915f19e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:25.396441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:25.505069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b066168-ad49-449b-a6fd-a555cc5bb8de None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:25.539564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:25.540431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:25.540708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:25.540979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] PATH_INFO: `/v3/system/users/d6ed7d9c3b5348ac861671d61915f19e/roles/bf63f7b41559454a964448f2cc159a20` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:25.542531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6ed7d9c3b5348ac861671d61915f19e, role_id=bf63f7b41559454a964448f2cc159a20)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:25.544514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4ca79-5109-465e-a1d2-31dc30aca65b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:25.555383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 165/334] 10.222.0.64 () {58 vars in 1334 bytes} [Wed May 11 06:25:25 2022] PUT /identity/v3/system/users/d6ed7d9c3b5348ac861671d61915f19e/roles/bf63f7b41559454a964448f2cc159a20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:27.297552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cae1-6d3b-4858-b02a-ff22a8baa07d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.298068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cae1-6d3b-4858-b02a-ff22a8baa07d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.298068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4cae1-6d3b-4858-b02a-ff22a8baa07d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.299777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 170/335] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:27.307053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.307053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.307053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.332470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:27.334029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:27.421945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 166/336] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:27.461461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4cae1-6d3b-4858-b02a-ff22a8baa07d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:27.600162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4cae1-6d3b-4858-b02a-ff22a8baa07d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:27.638856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:27.639677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.639954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.640225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.654019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:27.661896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:27.662785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:27.663579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:27.667371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 171/337] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:27.668854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:27.802064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d588a20-3284-4c64-8f50-c698de61b1b8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:27.840786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:27.842337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.842838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.843348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.844286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:27.844801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:27.846367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0a0bb-2285-4292-8f66-b2f190069695 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:27.858641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 167/338] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:27.863811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:27.870805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cb37-e6f4-4435-ad1d-b661293c48f2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.871375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cb37-e6f4-4435-ad1d-b661293c48f2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.871853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cb37-e6f4-4435-ad1d-b661293c48f2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.873444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 168/339] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:27.905180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:27.905788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:27.906262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:27.928457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:27.929940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:27.997318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf481d47-3bf2-4f1c-a5d7-89e6a3a81bc8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.039744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.040408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.040684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.040952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.078619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 169/340] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:28.124169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.189453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:28.191395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba0879-600a-4432-8aae-a446f565aad1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:28.257189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d59bb-4413-471a-bf44-c212f2bdc4b9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.299203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.300023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.300298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.300565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.316987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7da298d4-4367-4cf4-9a5a-8ea850ece109 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:28.324913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:28.326402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:28.327212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 170/341] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:28.332711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fc3e-0a40-456b-bebd-cd6622eebda5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.332980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fc3e-0a40-456b-bebd-cd6622eebda5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.333255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0fc3e-0a40-456b-bebd-cd6622eebda5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.334703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 171/342] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:28.336398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0fc3e-0a40-456b-bebd-cd6622eebda5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.363862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 172/343] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:28.365186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.365470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.365745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.402731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:28.402731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:28.468598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0fc3e-0a40-456b-bebd-cd6622eebda5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.501380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 173/344] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:28.502325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.524382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.525055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.525325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.525588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.526340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:28.526636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:28.528040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:28.546807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 172/345] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:28.552469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.667143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9ac94-3cb2-451e-8149-cf4d35842dc3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.673315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc45ba-423f-455c-aad1-c8beb4601ed0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.712847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.713765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.714758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.715194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.715348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.715604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.716747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.718234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:28.719952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:28.722281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 174/346] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:28.728246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.734609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:28.743192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:28.744175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:28.744983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:28.747923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 173/347] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:28.749011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.835802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93a9e-4cfd-49b8-b971-d89e56a72a38 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.859569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099f70-a160-460f-bf38-c77986f130b8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:28.876347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.877383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.877820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.878385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.906693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:28.908701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:28.908980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:28.909251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:28.922080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:28.923482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:28.925326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 174/348] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:28.925924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:28.978220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:28.979742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.094204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37701-815c-4b25-9c45-b08b9551392f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.115699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 175/349] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:29.116961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.133326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.134029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.134274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.134546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.135361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:29.135612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.136975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b3cd-129c-4835-9d10-f5102092d62e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.146260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 175/350] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:29.147930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b807-b4cb-4c11-a391-2b1a36e0a570 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.148211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b807-b4cb-4c11-a391-2b1a36e0a570 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.148484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b807-b4cb-4c11-a391-2b1a36e0a570 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.154049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 176/351] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:29.154851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b807-b4cb-4c11-a391-2b1a36e0a570 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.237020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808ba3-0ce3-4680-9a29-9c653a36e65c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.278724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.279049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.279370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.279645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.280482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=834e56c266a046559104d936315ca310, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:29.280791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.282240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.283639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b807-b4cb-4c11-a391-2b1a36e0a570 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.289075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 176/352] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=834e56c266a046559104d936315ca310 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:29.289947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.329024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.330620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.331115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.331593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.333265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.335046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7ba5c-cef6-48cb-bacc-5fb30a76488a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.337138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 177/353] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:29.338735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd11b-704a-4c76-aade-0013ed03a2f3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.339224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd11b-704a-4c76-aade-0013ed03a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.339724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd11b-704a-4c76-aade-0013ed03a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.360420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-845fd11b-704a-4c76-aade-0013ed03a2f3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:29.361950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-845fd11b-704a-4c76-aade-0013ed03a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:29.409653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cac3d-07f8-4047-bc6b-5fb5fd2cbe31 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.443395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 178/354] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:29.445260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd1e8f-4b66-454a-8283-0b150d4ea404 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.445726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd1e8f-4b66-454a-8283-0b150d4ea404 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.446176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd1e8f-4b66-454a-8283-0b150d4ea404 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.448179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 179/355] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:29.449137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd1e8f-4b66-454a-8283-0b150d4ea404 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.457103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.457778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.458059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.458334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.537313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.539110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.601025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd1e8f-4b66-454a-8283-0b150d4ea404 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.651575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.652477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.652759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.653032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.654755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.656260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1222-f83b-4fba-86a7-1d1363360634 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.657968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 180/356] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:29.659132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.659447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.659721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.662016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:29.662922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.676952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:29.678187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:29.773101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:29.774264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.791688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0632e1-31dc-44f6-acad-93e3b2bb6360 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.831778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.832594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.832872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.833144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.846802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:29.857930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:29.858823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:29.860560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 178/359] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:29.862135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.886370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8500cd-2537-4bb6-99b0-715a0fb6544c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:29.927192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:29.928096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.928385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.928650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.929856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:29.931363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34a518-9e2c-4094-8bc1-85e201823a3f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:29.933034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 182/360] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:29.935032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de656-e09c-4c1c-956b-94deb651e0da None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:29.935032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de656-e09c-4c1c-956b-94deb651e0da None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:29.935032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de656-e09c-4c1c-956b-94deb651e0da None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:29.936230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 183/361] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:29.936787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de656-e09c-4c1c-956b-94deb651e0da None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:29.996277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea1ce-87c0-410c-b8a3-ee88f09c1f53 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.039145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.039962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.040241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.040513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.041912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=834e56c266a046559104d936315ca310, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:30.042177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.044155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.051827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 179/362] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=834e56c266a046559104d936315ca310 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.052906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.068504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de656-e09c-4c1c-956b-94deb651e0da None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.116614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.118656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.119165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.119701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.136322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-182bbcc5-ec4a-4e11-946d-ed5836dd43b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:30.147630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:30.148593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 06:25:30.149398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:30.152979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 184/363] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:30.155674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.156177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.156629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.184782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:30.187433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:30.195744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6416f0-9242-4a2a-803f-bc1e7282fc16 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.241913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.244090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.244450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.244807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.245658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:30.246042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.248854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.262435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 180/364] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.264036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.287983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 185/365] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:30.288832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.388476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272766d-41cd-41f6-be7a-641a61a9fc60 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.415886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3f1e-278d-43d1-82b8-5ae5c4588a90 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.421141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.421993 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.422269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.422543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.423756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.425191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.428187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 181/366] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.428187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.475348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.476492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.476978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.477468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.478475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] RBAC: Adding query filter params (name=reader) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:30.478984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.480639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.489762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 186/367] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.490850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.536992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b82d-7e49-4773-8e60-47a49b837593 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.572985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.574063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.574504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.574947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.602314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafdfa-4e05-4c8e-ba63-fe6d76d002de None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.637463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.639226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.639742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.640256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.643623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.645088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.651919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:30.660249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:30.661145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:30.661921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:30.665542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 187/368] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:30.666550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.750981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 182/369] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:30.751824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.772578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cec85e-9f42-4e8f-b865-f0e03b85600b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.808784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.810366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.810879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.811411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.812465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:30.812991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.814617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.821099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 188/370] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=0b454d4febc34038bd35eda57f52340d => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.822215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.868009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af47bf-9fbd-419d-a8a6-a1c579fb051a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.918450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.919824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.920098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.920367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] PATH_INFO: `/v3/users/d6ed7d9c3b5348ac861671d61915f19e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.924091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ed7d9c3b5348ac861671d61915f19e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.925561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.927350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 183/371] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/users/d6ed7d9c3b5348ac861671d61915f19e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.928040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:30.935388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3656b-5e98-4574-ba29-3e312909bf4b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:30.971851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:30.973370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:30.974062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:30.974762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:30.975933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:30.976464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:30.978058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:30.987804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 189/372] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:30.988992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.068256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fbc79-115a-4165-9357-c598754f2bf0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.097311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c014cf-79ef-4189-b023-a464a363ee88 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.103720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.104597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.104869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.105133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.106946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.108473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.110527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 184/373] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:31.111018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.137049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.138333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.138827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.139356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.140430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] RBAC: Adding query filter params (role.id=bf63f7b41559454a964448f2cc159a20, user.id=d6ed7d9c3b5348ac861671d61915f19e, scope.system=all) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:31.141059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.142792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.156832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 190/374] 10.222.0.64 () {56 vars in 1308 bytes} [Wed May 11 06:25:30 2022] GET /identity/v3/role_assignments?user.id=d6ed7d9c3b5348ac861671d61915f19e&scope.system=all&role.id=bf63f7b41559454a964448f2cc159a20 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:31.158190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.221076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61526c-0dbf-447d-a9ce-e7f0e8f76acb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.258696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.259382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.259660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.259926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.270394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a8340-4f3c-4c61-a34c-ea9d089d32d8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.314812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.316140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.316652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.317131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.318872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.320704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.322767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 191/375] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:31.328938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.342637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.344211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.448146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 185/376] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:31.454400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.458068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0440f62-e752-4b0f-843c-8ab3cb3e0bf6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.502026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.503050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.503577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.504102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.505241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:31.505753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.507495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.514685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 192/377] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=0b454d4febc34038bd35eda57f52340d => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:31.557558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6020e-bf0e-4744-8c45-3d29f3e14a99 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.594407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.595295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.595572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.595835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] PATH_INFO: `/v3/projects/cddb71d6492441b395049ab068255bc5` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.597012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=cddb71d6492441b395049ab068255bc5)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.598452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.600472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 186/378] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/projects/cddb71d6492441b395049ab068255bc5 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:31.606029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.718933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead9170-0ab4-43a8-9565-02340ea1e027 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.756131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.756905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.757182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.757447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] PATH_INFO: `/v3/groups/f1617dc598aa41e582f42bfddec4c555` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.763045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] RBAC: Authorizing `identity:get_group(group_id=f1617dc598aa41e582f42bfddec4c555)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.764516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e8c8-7218-4998-b208-4ea0d77e67c4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.766514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 193/379] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/groups/f1617dc598aa41e582f42bfddec4c555 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:31.772333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:31.879231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d8caa-018b-4d39-8391-d8937f058ba3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:31.915842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:31.916531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:31.916785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:31.917048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:31.917883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] RBAC: Adding query filter params (group.id=f1617dc598aa41e582f42bfddec4c555, role.id=991b05c688cb448e83689717b7104be0, scope.project.id=cddb71d6492441b395049ab068255bc5) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:31.918188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:31.919751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8e13-1289-4d46-8158-27cd01e5b305 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:31.926342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 187/380] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:31 2022] GET /identity/v3/role_assignments?group.id=f1617dc598aa41e582f42bfddec4c555&scope.project.id=cddb71d6492441b395049ab068255bc5&role.id=991b05c688cb448e83689717b7104be0 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:32.087392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2c1-3dbb-4db1-b5ae-ce3bbe2758c3 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:32.087683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2c1-3dbb-4db1-b5ae-ce3bbe2758c3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:32.087875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2c1-3dbb-4db1-b5ae-ce3bbe2758c3 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:32.089493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 194/381] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:32.095436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:32.096021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:32.096504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:32.120390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:32.121632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:32.196541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 188/382] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:32.235721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d2c1-3dbb-4db1-b5ae-ce3bbe2758c3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:32.374777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d2c1-3dbb-4db1-b5ae-ce3bbe2758c3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:32.429255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:32.430225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:32.430326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:32.430585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:32.446899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:32.455311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:32.456166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:32.457366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 195/383] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:32.464028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:32.588007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1877c-d873-463a-ab88-a5ce2c60c2ba None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:32.625935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:32.626937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:32.627453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:32.627924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:32.628859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:32.629356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:32.630939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:32.640486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 189/384] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:32.647284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:32.780724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786ae7-4528-4842-bc13-9f5f25f86c1e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:32.822830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:32.824054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:32.824556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:32.825053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:32.826462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:32.828114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:32.830226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 196/385] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:32 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:32.835676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:32.970962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8390c-7073-4441-b13b-9b9993d8f468 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:33.005859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:33.006738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.007020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.011392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.012071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:33.014031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36e8f5-2765-419b-95a9-b2ab4b9ecc17 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:33.015946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 190/386] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:32 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:33.021490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:33.152630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199ff4-f803-47a5-af18-28b0489b3815 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:33.191958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:33.193160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.193435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.193704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.195760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, group_id=6c9cb483d8ba4f708e3ec3ec37e55410, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:33.197252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e55f16-066e-4748-a28b-7074fa05c05a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:33.217558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 197/387] 10.222.0.64 () {58 vars in 1442 bytes} [Wed May 11 06:25:33 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:33.470061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af87c-8b27-447e-be4a-b424edb15ea4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.470604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af87c-8b27-447e-be4a-b424edb15ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.470604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af87c-8b27-447e-be4a-b424edb15ea4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.472546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 191/388] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:33.489620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.489912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.490184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.510142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:33.511343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:33.584089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 198/389] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:33.611140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097af87c-8b27-447e-be4a-b424edb15ea4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:33.719492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097af87c-8b27-447e-be4a-b424edb15ea4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:33.759674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:33.760530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.760800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.761068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.775963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:33.783751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:33.784623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:33.785404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 192/390] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:33.790974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:33.892594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2461fdf-6a4c-4605-97fd-b385fb833200 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:33.926916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:33.927659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:33.927938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:33.928205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:33.928948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:33.929247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:33.930621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:33.940216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 199/391] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:33.946010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.046333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e0a3-83b9-4d63-8b63-01c05f481229 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:34.080580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:34.081444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.081718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.081984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.083238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:34.084760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:34.086420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 193/392] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:33 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:34.092720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.210809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996727-7558-4018-9d80-7110f93809ea None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:34.252269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:34.253503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.254004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.254477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.260023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:34.261722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cae7f7-e3e6-47f3-ac9d-4487a6f9c0df None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:34.263749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 200/393] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:34 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:34.269463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.385774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad6797-d71c-466f-8eb7-aeca470c28f8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:34.419797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:34.420743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.421018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.421283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.423448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, group_id=6c9cb483d8ba4f708e3ec3ec37e55410, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:34.424910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a575ee-ef61-4410-aa3d-e6f5f617db20 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:34.441561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 194/394] 10.222.0.64 () {58 vars in 1442 bytes} [Wed May 11 06:25:34 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:34.460357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1514f2-d4d7-49c7-97ea-317306661f0e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.460664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1514f2-d4d7-49c7-97ea-317306661f0e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.461072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1514f2-d4d7-49c7-97ea-317306661f0e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.469504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 201/395] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:34.476107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431073c-aa2f-481f-a47b-f3ed84951577 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.477046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431073c-aa2f-481f-a47b-f3ed84951577 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.477497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431073c-aa2f-481f-a47b-f3ed84951577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.504506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e431073c-aa2f-481f-a47b-f3ed84951577 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:34.506032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e431073c-aa2f-481f-a47b-f3ed84951577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:34.585963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 195/396] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:34.617093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1514f2-d4d7-49c7-97ea-317306661f0e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.680506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3221-0b03-4569-9121-4b00b9fa39ea None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.681114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3221-0b03-4569-9121-4b00b9fa39ea None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.682218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b3221-0b03-4569-9121-4b00b9fa39ea None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.684561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 196/397] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:34.690140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015349f-4bcb-48fa-855a-ce805e612e9e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.690940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015349f-4bcb-48fa-855a-ce805e612e9e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.691821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015349f-4bcb-48fa-855a-ce805e612e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.713476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b015349f-4bcb-48fa-855a-ce805e612e9e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:34.715024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b015349f-4bcb-48fa-855a-ce805e612e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:34.757886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1514f2-d4d7-49c7-97ea-317306661f0e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:34.789739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 197/398] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:34.791183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a75e-b807-4f2f-9e38-bd10ee4a7de9 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.791500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a75e-b807-4f2f-9e38-bd10ee4a7de9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.791779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a75e-b807-4f2f-9e38-bd10ee4a7de9 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.797110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 198/399] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:34.797817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:34.798557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.798668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.798842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.798953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.799110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.799200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.814585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:34.816326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:34.817503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:34.824033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:34.825096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:34.826385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:34.826972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 202/400] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:34.827601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.894046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 199/401] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:34.894958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:34.951679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075c34-9f50-446b-a7e3-70be9673b366 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:34.986533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:34.987147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:34.987460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:34.987734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:34.999242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:35.007624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:35.008547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:35.009310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 203/402] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:35.009996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.015747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5321f58-9cd3-48f8-9004-f482877458e1 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.057211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.058685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.059186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.060197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.061493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:35.062324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.064271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.075926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 200/403] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.077705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.133849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764959-f04a-4c3a-bad7-62b03dbedabb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.187463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.188325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.188606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.188925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.200680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:35.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:35.212621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:35.213399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:35.214709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fec9f-ec51-4f2c-9559-c134e48e47b1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.214784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 204/404] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:35.214784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.260554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.261226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.261506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.261775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.262552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:35.262859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.264258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.275232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 201/405] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.276366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.343409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a291-cec7-4499-8968-f284990f0f58 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.376463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.377320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.377601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.377876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.379071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.380550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.382510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 205/406] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.383390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.385657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab38d9-bae4-42c2-91f1-59c767a8069b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.431545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.432463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.432967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.433438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.434485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:35.435111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.436917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.446456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 202/407] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.447579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.489665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5b06-8f30-4486-baac-58384726be5e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.524273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.525130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.525413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.525673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.526857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.528876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.534980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 206/408] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.535868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.553951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fbab5-5ee0-46ac-add3-9256c9c1c232 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.589782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.591076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.591608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.592083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.593583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.595234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.597209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 203/409] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.598210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.634581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916fdc-eb09-4c22-b7bb-5d3e5d02eb6c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.668260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.669155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.669445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.670406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] PATH_INFO: `/v3/groups/f1617dc598aa41e582f42bfddec4c555` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.671033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] RBAC: Authorizing `identity:get_group(group_id=f1617dc598aa41e582f42bfddec4c555)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.672512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.674432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 207/410] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/groups/f1617dc598aa41e582f42bfddec4c555 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.675176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.702463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65a92-5cc6-48a5-8358-0531e1a0fd5a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.736510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.737763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.738248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.738718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.740300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.742029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.744350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 204/411] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.745323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.778442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2581-3a00-4e17-835f-418c44ab1e7e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.812321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.813152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.813432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.813704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.815985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee8ce5419e47ce808a43f5a067142d, group_id=6c9cb483d8ba4f708e3ec3ec37e55410, role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.817432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.835510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 208/412] 10.222.0.64 () {58 vars in 1442 bytes} [Wed May 11 06:25:35 2022] PUT /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/0b454d4febc34038bd35eda57f52340d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:35.836563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.856939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f50f-2be0-43ed-8b68-92363a9ac452 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:35.897346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:35.898593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:35.899152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:35.899665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] PATH_INFO: `/v3/projects/cddb71d6492441b395049ab068255bc5` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:35.901162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] RBAC: Authorizing `identity:get_project(project_id=cddb71d6492441b395049ab068255bc5)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:35.903014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:35.905518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 205/413] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:35 2022] GET /identity/v3/projects/cddb71d6492441b395049ab068255bc5 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:35.911391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:35.965666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810a52-87bc-4a8b-a50e-26833a19da1c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:36.054093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:36.054916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.055196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.055506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.061726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] RBAC: Authorizing `identity:create_grant(project_id=45e0ff8e2fc14cae816a4d6fd81b271f, group_id=6c9cb483d8ba4f708e3ec3ec37e55410, role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:36.063191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eee48e-7bd3-4ea2-8747-f5ddd15a67cd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:36.063556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617824f-414b-40f1-be1c-e80d81870317 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:36.083674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 209/414] 10.222.0.64 () {58 vars in 1442 bytes} [Wed May 11 06:25:35 2022] PUT /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f/groups/6c9cb483d8ba4f708e3ec3ec37e55410/roles/0b454d4febc34038bd35eda57f52340d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:36.111653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:36.112857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.113310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.113784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] PATH_INFO: `/v3/projects/cddb71d6492441b395049ab068255bc5/groups/f1617dc598aa41e582f42bfddec4c555/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.116149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] RBAC: Authorizing `identity:create_grant(project_id=cddb71d6492441b395049ab068255bc5, group_id=f1617dc598aa41e582f42bfddec4c555, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:36.118157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c91830-0c3b-49b7-875d-eaa5c6bebdbe None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:36.135790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 206/415] 10.222.0.64 () {58 vars in 1442 bytes} [Wed May 11 06:25:35 2022] PUT /identity/v3/projects/cddb71d6492441b395049ab068255bc5/groups/f1617dc598aa41e582f42bfddec4c555/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:36.368436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d277fa-2ecf-47ef-83fd-29e3450cf380 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.368639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d277fa-2ecf-47ef-83fd-29e3450cf380 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.368919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d277fa-2ecf-47ef-83fd-29e3450cf380 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.370553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 210/416] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:36.376554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.376842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.377122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.394363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:36.395568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:36.473840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 207/417] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:36.520736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d277fa-2ecf-47ef-83fd-29e3450cf380 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:36.664960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d277fa-2ecf-47ef-83fd-29e3450cf380 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:36.717170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:36.717972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.718250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.718524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.736159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:36.743898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:36.744824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:36.745599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:36.749880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 211/418] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:36.761087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:36.923338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c64963-5365-48d2-8c04-0411bd419c53 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:36.972386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:36.973060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:36.973335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:36.973606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:36.974354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] RBAC: Adding query filter params (name=member) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:36.974657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:36.976053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d402-07ba-46f1-a1b5-fb96affafbee None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:36.990600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 208/419] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:36.996268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.102334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911f13-2889-4da1-90d6-cef87194a4da None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.137413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f575dd-1e14-4b09-a017-5c14715e98de None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.138287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f575dd-1e14-4b09-a017-5c14715e98de None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.138500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f575dd-1e14-4b09-a017-5c14715e98de None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.140094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 209/420] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:37.140726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.141472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.141750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.142020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.145063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.145336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.145604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.172552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:37.173953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:37.218227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:37.219723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:37.295790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 210/421] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:37.320736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 212/422] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:37.322015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.330448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.469288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e9637-1227-4cd6-a5ff-00528cfbf501 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.509974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f253-9598-4973-9368-7537ca0fecd8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.516691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.517502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.517776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.518043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.544476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:37.560543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:37.561508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:37.562380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 213/423] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:37.573199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.578805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.579715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.579993 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.580264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.586049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:37.587527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:37.594242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 211/424] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:37.597369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.730709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983416c-61c0-4089-abf0-e02a7a19ac87 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.765371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.766036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.766315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.766594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.767357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] RBAC: Adding query filter params (name=member) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:37.767664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:37.769019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:37.786184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666c53-5c07-46c1-9f3a-d976d150f773 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.791878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 214/425] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:37.792755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.831481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.832389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.832663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.832983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.835072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:37.836539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:37.840479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 212/426] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:37.845344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:37.957760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3674-c5fa-49d1-b2fa-f3f8ba48f97c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.987206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac739-9683-42ae-85e3-2a8603114974 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:37.991624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:37.992283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:37.992560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:37.992830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:37.993656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=834e56c266a046559104d936315ca310, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:37.993964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:37.995442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:38.002326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 213/427] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=834e56c266a046559104d936315ca310 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:38.031287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:38.032030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.032254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.032531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.126591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:38.128094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:38.259658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 215/428] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:38.265177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:38.369771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645bfe5-a246-4412-88c0-31c328f63b4b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:38.410666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:38.410666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.410666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.410666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.411987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:38.413436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:38.419537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 214/429] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:38 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:38.421521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:38.536373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab9d09-6488-4d4f-8244-a9cd179f18f7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:38.576354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:38.577287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.577568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.577836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.579125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:38.580687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a819ddc-5bb1-45d3-adee-cdb1ac6474d8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:38.582763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 216/430] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:38 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:38.588838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:38.715116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ec4d-0f09-4861-9cba-15f4ab0ea021 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:38.754477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:38.755137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.755496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.755775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.756605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=834e56c266a046559104d936315ca310, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:38.756912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:38.758353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406bd61-9deb-457f-a20e-7db80461b661 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:38.766297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 215/431] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:38 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=834e56c266a046559104d936315ca310 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:38.778583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba049c-3a9d-41f4-9112-298884a97177 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.778875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba049c-3a9d-41f4-9112-298884a97177 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.779150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba049c-3a9d-41f4-9112-298884a97177 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.780901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 217/432] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:38.786647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.787250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.787250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.805273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:38.806486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:38.875761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0918-bcd2-45e9-a689-1f78a53b8dee None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.876397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0918-bcd2-45e9-a689-1f78a53b8dee None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.876874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0918-bcd2-45e9-a689-1f78a53b8dee None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.878644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 218/433] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:38.884571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879551e8-1341-416c-96f7-f361cc0e8547 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:38.884880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879551e8-1341-416c-96f7-f361cc0e8547 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:38.884977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 216/434] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:38.885126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879551e8-1341-416c-96f7-f361cc0e8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:38.909587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:38.911745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-879551e8-1341-416c-96f7-f361cc0e8547 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:38.913933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-879551e8-1341-416c-96f7-f361cc0e8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:38.998504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 219/435] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:39.000116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e1f1-2506-4409-b2c0-e88871eb7901 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.000571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e1f1-2506-4409-b2c0-e88871eb7901 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.000990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849e1f1-2506-4409-b2c0-e88871eb7901 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.002415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 220/436] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:39.009220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.009505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.009781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.031834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:39.033092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:39.036122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa35af-53f5-4fd0-ab20-78e69d1e540d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.072683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.073831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.074108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.075503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.084862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:39.093072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:39.094002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 217/437] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:39.099829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.104374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 221/438] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:39.105203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.187529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85507c90-b1fd-497b-b02f-8478a91cb053 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.197051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb7f9-d1cd-4783-9fee-cee72bded1d1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.219514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.220460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.220740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.221012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.229615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.230280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.230561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.230835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.231081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:39.231629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:39.231936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.233300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:39.239256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:39.240334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:39.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 218/439] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:39.241838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 222/440] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:39.241914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.246600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.336130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656289-959e-4c27-9859-b308c6be60b3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.338958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10b44-367f-4eaa-871d-bdab72643014 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.366624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.367455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.367739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.368013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.371518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.372726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.373004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.373274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.374011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:39.374315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.375694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.378260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:39.383226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 223/441] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:39.384018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:39.386256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:39.387514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:39.389307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 219/442] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:39.392118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.478425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb4f12-82be-4548-8333-7db4f2978225 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.484996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142629-77fe-4b4e-ba94-0db25b27b6c7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.510910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.511582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.511864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.512137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.517075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.517708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.517983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.518246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.576494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.577943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.579883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.581313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.672177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 220/443] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:39.672624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 224/444] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:39.673648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.677615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.764051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868066-9359-432b-88b1-2090a1f9932d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.767820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d19cd1-4ccf-4633-a007-431b8a66b28e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.795130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.795813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.796092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.796358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.797087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:39.797390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.798754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.799007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.799890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.800158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.800424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] PATH_INFO: `/v3/projects/d9ee8ce5419e47ce808a43f5a067142d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.801567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee8ce5419e47ce808a43f5a067142d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.802955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.804690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 225/445] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/projects/d9ee8ce5419e47ce808a43f5a067142d => generated 298 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:39.805423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.809034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 221/446] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:39.810733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.897306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0603ea-583d-4833-8f96-290ab2feb062 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.900189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eee39-cc24-4e0d-962b-6e287884d9f5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:39.928839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.929620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.929900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.930165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] PATH_INFO: `/v3/projects/cddb71d6492441b395049ab068255bc5` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.931329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:39.931451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] RBAC: Authorizing `identity:get_project(project_id=cddb71d6492441b395049ab068255bc5)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.932173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:39.932455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:39.932736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.932824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:39.933904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:39.934946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 226/447] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/projects/cddb71d6492441b395049ab068255bc5 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:39.935769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:39.935988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:39.937614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 222/448] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:39.940203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.031344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4598-e79f-497e-bcda-55cda2a72da8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.038392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6104f-dcd1-4840-9903-4c6e817618b8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.063421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.064063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.064343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.064614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.070207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.071052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.071358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.071629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] PATH_INFO: `/v3/groups/f1617dc598aa41e582f42bfddec4c555` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.072795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] RBAC: Authorizing `identity:get_group(group_id=f1617dc598aa41e582f42bfddec4c555)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.074223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.075884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 223/449] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/groups/f1617dc598aa41e582f42bfddec4c555 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:40.076635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.128032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.129460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.168119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da879b1-a9d9-4c19-a5d9-d5af6579827e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.199430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.200023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.200299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.200576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.201388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=d9ee8ce5419e47ce808a43f5a067142d) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:40.201692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.203099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.208712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 224/450] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:40 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=d9ee8ce5419e47ce808a43f5a067142d&role.id=0b454d4febc34038bd35eda57f52340d => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:40.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.220947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 227/451] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:40.226768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.335847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b2b9f-b5c3-4d92-8dff-069e4e7017b6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.342802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd969a5f-91e4-4a86-9d25-c7640dc7e9a6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.372605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.373477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.373749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.374013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] PATH_INFO: `/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.375287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=45e0ff8e2fc14cae816a4d6fd81b271f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.376754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.378504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 228/452] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:25:40 2022] GET /identity/v3/projects/45e0ff8e2fc14cae816a4d6fd81b271f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:40.380799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.381700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.382161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.382637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.383791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] RBAC: Adding query filter params (group.id=f1617dc598aa41e582f42bfddec4c555, role.id=991b05c688cb448e83689717b7104be0, scope.project.id=cddb71d6492441b395049ab068255bc5) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:40.384166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.384479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.386065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.393477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 225/453] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:40 2022] GET /identity/v3/role_assignments?group.id=f1617dc598aa41e582f42bfddec4c555&scope.project.id=cddb71d6492441b395049ab068255bc5&role.id=991b05c688cb448e83689717b7104be0 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:40.504957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ee25-a1ba-416c-ae4f-bef9a8ba4ab4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.541194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.542059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.542338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.542603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] PATH_INFO: `/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.545363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] RBAC: Authorizing `identity:get_group(group_id=6c9cb483d8ba4f708e3ec3ec37e55410)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.546811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c9637-4eb6-4dd2-9c56-05ed6b365157 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.548541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 229/454] 10.222.0.64 () {56 vars in 1180 bytes} [Wed May 11 06:25:40 2022] GET /identity/v3/groups/6c9cb483d8ba4f708e3ec3ec37e55410 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:40.554476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:40.657575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2111f-8c6b-4e26-bdbd-1d13c12699ca None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:40.690505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:40.691167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:40.691479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:40.691752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:40.692587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] RBAC: Adding query filter params (group.id=6c9cb483d8ba4f708e3ec3ec37e55410, role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:40.693153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:40.694597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d3ed-a1b3-499e-94cb-ad6b74995d44 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:40.700421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 226/455] 10.222.0.64 () {56 vars in 1376 bytes} [Wed May 11 06:25:40 2022] GET /identity/v3/role_assignments?group.id=6c9cb483d8ba4f708e3ec3ec37e55410&scope.project.id=45e0ff8e2fc14cae816a4d6fd81b271f&role.id=0b454d4febc34038bd35eda57f52340d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:43.705892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fd0f-4926-49c8-b169-b14771b98aa8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:43.706380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fd0f-4926-49c8-b169-b14771b98aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:43.706380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990fd0f-4926-49c8-b169-b14771b98aa8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:43.707982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 230/456] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:43.713618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d159-95e1-40b8-8d77-fd3155eb2448 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:43.714255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d159-95e1-40b8-8d77-fd3155eb2448 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:43.714255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395d159-95e1-40b8-8d77-fd3155eb2448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:43.736340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2395d159-95e1-40b8-8d77-fd3155eb2448 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:43.737548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2395d159-95e1-40b8-8d77-fd3155eb2448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:43.820504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 227/457] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:43.864824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990fd0f-4926-49c8-b169-b14771b98aa8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:43.889243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc524f-aaf4-4e97-a58b-b169d8b9645c None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:43.889664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc524f-aaf4-4e97-a58b-b169d8b9645c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:43.890174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc524f-aaf4-4e97-a58b-b169d8b9645c None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:43.892627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 228/458] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:43.900563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19adb-d886-42f7-aa3b-79a3599721a8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:43.901176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19adb-d886-42f7-aa3b-79a3599721a8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:43.901799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19adb-d886-42f7-aa3b-79a3599721a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:43.933800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e6a19adb-d886-42f7-aa3b-79a3599721a8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:43.935073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e6a19adb-d886-42f7-aa3b-79a3599721a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:43.991364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990fd0f-4926-49c8-b169-b14771b98aa8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.028842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.030058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.030529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.030984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.041498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.043204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:44.061462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:44.062353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:44.063209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:44.063209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:44.063209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.063209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:44.065439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 231/459] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:44.071195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.084292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 229/460] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:44.113657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6e4b-22a9-41f9-a1e4-9ca9e9fc8b02 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.113940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6e4b-22a9-41f9-a1e4-9ca9e9fc8b02 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.114383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6e4b-22a9-41f9-a1e4-9ca9e9fc8b02 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.116174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 230/461] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:25:44.121394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.121897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.122317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.143853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:44.145716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:44.197528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92673-55dc-4a3f-98c7-34a6ec5e851f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.219648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 231/462] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 06:25:44.220311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.239946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.240922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.241455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.241948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.243329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:44.243927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.245780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4ab4-2718-4d3c-9dad-17b31ac9956d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.258918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 232/463] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:44.260542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d52-e3f5-43f0-b843-a23e105fc9d5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.260824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d52-e3f5-43f0-b843-a23e105fc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.261094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d52-e3f5-43f0-b843-a23e105fc9d5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.262824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 233/464] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:44.263742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5d52-e3f5-43f0-b843-a23e105fc9d5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.325366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fecf-1efc-4e40-bc19-1d9377e0e709 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.358476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.359536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.359815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.360095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.369750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.371225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.381936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5d52-e3f5-43f0-b843-a23e105fc9d5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:44.388901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:44.389713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:44.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:44.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:44.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:44.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 232/465] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:44.391304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.423219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.424038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.424323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.424591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.439317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.440777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d3bc6376-1df4-4289-8573-2ce3ecbcf3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:44.458548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:44.459626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:44.460486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:44.460486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:44.460486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.460486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:44.460486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 234/466] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:44.461060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.461226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.461505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.479286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:44.480507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:44.496900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc60ad-506a-4978-8e76-4e3b1cabacb0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.530943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.531940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.532494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.532494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.533162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.534580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.559633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 235/467] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:44.559633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.563722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 233/468] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:44 2022] POST /identity/v3/users => generated 248 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:44.564593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.683738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97081a8c-e7b3-4cb3-b8b3-2904cfcf91e8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.710664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe51f-ab8c-454f-a902-c447ec9623c6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.724655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.725405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.725672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.725952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.726893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:44.727204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.729437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.750837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 236/469] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:44.750837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.751079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.751079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.751079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.751079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.751678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:44.751678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.753294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.765315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 234/470] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:44.766477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.851841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8a55-c85a-4970-b5e9-cf904112d5f4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.873195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd619-ca53-46dc-a306-130391f0cc2b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:44.884176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.884965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.885244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.885515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.896262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.897687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.905840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:44.906505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.906785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.907057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.907796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:44.909226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4b84bc57-4061-4e3d-b4e8-0f0275b5d23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:44.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:44.914985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:44.915837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:44.915837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:44.915837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:44.915837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:44.915837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 237/471] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:44.917028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014f57-7396-4325-aa5c-edca8b059764 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:44.917313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014f57-7396-4325-aa5c-edca8b059764 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:44.917592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014f57-7396-4325-aa5c-edca8b059764 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:44.919389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 238/472] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:44.922147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014f57-7396-4325-aa5c-edca8b059764 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:44.933329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 235/473] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:44 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:44.933329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:45.044241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fc30-e840-424c-b808-1a25f8137701 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.077013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014f57-7396-4325-aa5c-edca8b059764 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.079906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.080654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.080937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.081210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.081945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:45.082249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:45.083708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5606d8d-d1ff-404c-a64b-d9406b222e38 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:45.097548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 236/474] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:45.098823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.099108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.099435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.119494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:45.120726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:45.134165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.135166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.135699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.135972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.136680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:45.138135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:45.165515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 239/475] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:44 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:45.166509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:45.211391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 237/476] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:45.242038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:45.304546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1176e7-e7ec-4c59-9a08-597747074f85 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.342853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.343584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.343867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.344192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.344931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:45.346426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:45.351413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186682b-6586-4685-a829-86e35a0dc114 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.373734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 240/477] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:45 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:45.392525 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.393267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.393551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.393824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.394637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:45.396121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:45.405954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.sql.core [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:25:45.405954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 06:25:45.405954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [parameters: {'id': '7e7a272f1afa498f8ebd35bfe8ab1ba9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 06:25:45.405954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79985) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application conn.query(q) May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result.read() May 11 06:25:45.422808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return ref.to_dict() May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:25:45.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application next(self.gen) May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application yield resource May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application next(self.gen) May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise self.value May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application session.commit() May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:25:45.424640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.session.flush() May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application compat.raise_( May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:25:45.425519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:25:45.426386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application conn.query(q) May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result.read() May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:25:45.427196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [parameters: {'id': '7e7a272f1afa498f8ebd35bfe8ab1ba9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:45.430410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 06:25:45.440030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:45.442531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 238/478] 10.222.0.64 () {60 vars in 1131 bytes} [Wed May 11 06:25:45 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:45.442924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:45.549511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfec5d-4f7c-4048-bdfe-9c52b5d5c264 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.585325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.586115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.586398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.586724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.598621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-359991d2-861f-4082-ad10-e087745dc491 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:45.610891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:45.612587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:45.614581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 241/479] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:25:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:45.620384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:45.721740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db64a7-7d01-4e4d-b7d1-6c158fa9c592 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:45.755425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:45.756157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:45.756361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:45.756634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:45.757386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:45.757746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:45.759181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589094ac-119b-4278-8b3d-fc51ff95d7e3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:45.771850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 239/480] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:47.100645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94120-a59e-4169-898a-d793ff4a6f25 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.101322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94120-a59e-4169-898a-d793ff4a6f25 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.101322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94120-a59e-4169-898a-d793ff4a6f25 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.102787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 242/481] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:47.108886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.109354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.109506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.132380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:47.133614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:47.218415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 240/482] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:47.257121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a94120-a59e-4169-898a-d793ff4a6f25 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:47.390055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a94120-a59e-4169-898a-d793ff4a6f25 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:47.432766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:47.433584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.433857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.434157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.455912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:47.463820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:47.466570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:47.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 243/483] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:47.472793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:47.622341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3ec01-d63e-45f8-8cdf-6acce328204f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:47.666185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:47.667186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.667692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.668165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.669158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:47.669656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:47.671220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe4919-fff1-4f15-b1c8-164f2355cb16 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:47.679682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 241/484] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:47.687300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:47.758319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbebfb4-d0bc-4148-89b7-c4fa84407d04 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.758943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbebfb4-d0bc-4148-89b7-c4fa84407d04 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.759479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbebfb4-d0bc-4148-89b7-c4fa84407d04 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.761283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 242/485] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:47.767035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308289a2-163b-415a-a79a-14514254a098 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.767585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308289a2-163b-415a-a79a-14514254a098 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.768055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308289a2-163b-415a-a79a-14514254a098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.793705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-308289a2-163b-415a-a79a-14514254a098 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:47.795871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-308289a2-163b-415a-a79a-14514254a098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:47.834204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b589d-6533-4668-aaf6-b09e8b8be61a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:47.871298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:47.873518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:47.874493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:47.875456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:47.896422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:47.898200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:47.927535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:47.928443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:47.929412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:47.929412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:47.929412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:47.929412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:47.935862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 244/486] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:47.947197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:47.949963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 243/487] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:48.013099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308289a2-163b-415a-a79a-14514254a098 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.102041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec781b1f-3d1f-464b-9d5f-bb26572b08ab None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.153864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308289a2-163b-415a-a79a-14514254a098 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.163592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.164262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.164539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.164810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.165533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:48.165842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.167200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.192007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 245/488] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:48.197264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.212176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.213425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.213711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.213985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.229466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a8ec2bfd-7de8-42cb-ae81-9ba0db8125ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:48.240827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:48.241836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:48.242613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 244/489] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:48.243365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824c00-20c3-4457-a2de-c0649632f3d4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.244416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824c00-20c3-4457-a2de-c0649632f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.247290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24824c00-20c3-4457-a2de-c0649632f3d4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.247290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 245/490] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:48.250002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824c00-20c3-4457-a2de-c0649632f3d4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.308351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d396-0b42-43ee-832d-67a0e53f4e86 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.351753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.352820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.353099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.353372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.363677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.365001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24824c00-20c3-4457-a2de-c0649632f3d4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.365299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9820eb4e-c39a-418f-9fd3-2e3d101909b7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:48.385378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:48.387136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 246/491] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.389067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.390095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.406561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.406561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.406561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.406561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.406978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:48.406978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.406978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.413848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:48.413848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:48.414889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 246/492] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:48.416010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.480751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 247/493] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:48.482352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.529120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d22a2d-ecc8-424b-8142-07d61e2c1163 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.565518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.566471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.566747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.567022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.568156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:48.568463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.569885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f64269-cfd7-4aa6-895c-02f966635eee None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.585525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4526-a4a7-4daf-b361-e8309774106f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.607522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 247/494] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:48.609229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4283f2-2a13-438e-b44f-b8d97d86964e None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.609586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4283f2-2a13-438e-b44f-b8d97d86964e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.609938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4283f2-2a13-438e-b44f-b8d97d86964e None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.611235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 248/495] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:48.612209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4283f2-2a13-438e-b44f-b8d97d86964e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.626940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.627775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.628116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.628387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.638362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.639848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:48.661139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:48.662022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 248/496] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:48.667628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.709387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4283f2-2a13-438e-b44f-b8d97d86964e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.741187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.741907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.742184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.742455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.751943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-e35a3cf1-45be-4a7c-bc6b-04ffedb5e2cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:48.759577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:48.760431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:48.761203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:48.763953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 249/497] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:48.765157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.765439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.765712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.767155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58920e-1527-4a94-b58a-6ec6e09a172f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.781695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:48.782847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:48.799386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.800029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.800313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.800585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.844915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 250/498] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:48.845763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.864195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.865731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299463c-22a8-47aa-90c3-766187347103 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.945340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ea77-d2ae-43d6-a6b8-8a4a5480d29d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:48.958016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 249/499] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:48.959364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7c6a-5602-4f9f-ae69-4e6ec0df4373 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.959649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7c6a-5602-4f9f-ae69-4e6ec0df4373 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.959928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7c6a-5602-4f9f-ae69-4e6ec0df4373 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.961170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 250/500] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:48.961853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7c6a-5602-4f9f-ae69-4e6ec0df4373 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:48.978722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:48.979473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:48.979749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:48.980016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:48.980723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:48.981066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:48.982442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:48.992981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 251/501] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:48.993673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.057417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7c6a-5602-4f9f-ae69-4e6ec0df4373 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.085643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aef854-96f7-4dd0-ad51-3df31b8eeab5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.089918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.090618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.090893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.091161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.091918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.092227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.093583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.100990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 251/502] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.101751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.121253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.122567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.122849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.123124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.132785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-82cb4e98-d226-4d04-a3b6-dddceca0196a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:49.141084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.141970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:49.143045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 252/503] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.143870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.144021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.144269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.159730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:49.160906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:49.193978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a4559-cfc8-41fb-b1a1-fd973ed4a791 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.239294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 253/504] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:49.239294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.239558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.239558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.239558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.239558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.239860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.239860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:49.255676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.256496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.257330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:49.257330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:49.257330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.257330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:49.257330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 252/505] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.257592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.315567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf5fc-21c4-4d37-b383-a4e2b84e3fc5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.347636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.348420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.348698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.348968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.353177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394df4-cb13-4151-8f95-be2c122e15ca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.355636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.357112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:49.373377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.374470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:49.375498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 254/506] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.376050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.386963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.388328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.388607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.388879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.399101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.400564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:49.417133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.417952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.419366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:49.419366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:49.419366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.419366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:49.419366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 253/507] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.419682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.473322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f68cf3-7a68-4184-9f4d-693cf4420e04 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.506034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.506632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.506909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.507178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.507946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.508248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.509617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.514562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9998bc-5575-4a4f-84f8-3095a2963486 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.517143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 255/508] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.517904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.546925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.547743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.548022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.548294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.558241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.560253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:49.576695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.577570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.578378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:49.578378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:49.578378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.578378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:49.578378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 254/509] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.578918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.616075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0bb77-efd3-41bf-8560-dba1245aff21 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.647252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.647929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.648206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.648474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.649185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.649489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.650842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.661926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 256/510] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.662699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.674647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eacfb-e821-4bb9-810b-decf6e7f6edf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.706114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.706774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.707051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.707351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.708176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.708481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.709902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.746162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 255/511] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.747590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.754095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48666e30-db9f-4a65-8a53-81e991163711 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.785153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.785733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.786004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.786269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.786974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.787281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.788646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.799830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 257/512] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.800605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.840801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033723ad-4fb8-4e0e-b226-cfd6f3226c36 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.872300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.873080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.873357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.873626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.883117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.884572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.892140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb2839-ab5d-432d-979a-e7793f711351 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:49.901201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:49.902037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 256/513] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:49.908080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:49.923813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:49.924456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:49.924734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:49.925000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:49.925698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:49.925998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:49.927410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:49.938346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 258/514] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:49.939099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.005060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a47cb-a389-4cf8-b9d5-56cad7ff4b0e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.029854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91e6e-89da-4643-9895-150c0ef42983 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.037206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.037935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.038217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.038488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.045574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.046996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:50.061356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:50.062179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:50.063000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:50.066497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.066497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.066652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 257/515] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:50.066720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.066720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.066835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.128356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.129810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.154642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61be9-7905-4daf-83a9-c5e43317cd37 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.186087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.186863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.187140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.187436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.194312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.195767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:50.210165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:50.211088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:50.211992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 258/516] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:50.212534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.226841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 259/517] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:50.226841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.303760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ecdff-7a27-4323-bf9e-e8743b3f3a8b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.320212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605759-5af7-470b-8230-210d4ce938b3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.335631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.336293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.336576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.336852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.337568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:50.337897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.339294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.350545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 259/518] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:50.351355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.355458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.356148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.356478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.356749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.357547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.358968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.378001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 260/519] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:25:50 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:25:50.378913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.458457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4e2c5-15c0-498b-8b0b-f7c66bcfc39b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.485734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7b61d-3e36-4cc3-9594-b7c2fc1c1b83 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.493409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.494521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.494521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.494690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.495411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:50.495717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.497351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.517113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 260/520] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:50.518097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.525210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.525923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.526180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.526504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.527397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:50.528357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.529913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.548347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 261/521] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:50.549522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.628141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699cfd-7ce7-460b-b32c-e38059aca462 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.657056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23396-9ca0-44e0-af19-36b23af1e664 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.661927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.662724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.663006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.663299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.673073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.674513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.689516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.690315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.690595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.690866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:50.692192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:50.693258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:50.694083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:50.694083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:50.694083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:50.694083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:50.698149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 261/522] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:50.698273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.698980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.699712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:50.714791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:50.715800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 262/523] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:50.717251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.799670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875165-974a-455c-9c0f-79d82af79927 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.813074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dc499-8f71-4b20-a855-494e01101c6e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.833490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.834144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.834425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.834700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.835560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=a776f52df1c944ed9b28524b7c582e0c) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:50.835887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.837316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.851638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 262/524] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/role_assignments?user.id=a776f52df1c944ed9b28524b7c582e0c&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:50.851638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:50.855138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.855900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.856185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.856457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.930772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.932206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:50.952158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96007d4-4d53-489e-800e-1dd0485ffa1a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:50.989267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:50.989958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:50.990541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:50.990824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:50.991606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:50.992087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:50.994233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.023508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 263/525] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:51.025540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.051076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 263/526] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:51.051794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.130458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78938-f680-4a0c-9b3f-2667f8b1aa50 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.149962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf5cce-5149-4c92-b467-294fc8bd7b42 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.165718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.166566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.166851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.167457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.168837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:51.169154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.171038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.186304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.187111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.187486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.187827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.193099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 264/527] 10.222.0.64 () {56 vars in 1139 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:51.194038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.195676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.197257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:51.212505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:51.213381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:51.214209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 264/528] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:51.214654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.317052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347c11-570c-47f8-a189-ce5708c4f5ce None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.318410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507b78-200f-4741-b5a5-72642f3cb8b6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.355807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.356682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.357085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.357251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.357395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.357534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.357684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.357824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.371665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.373282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:51.396062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:51.397884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 265/529] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:51.399674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.427764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.429308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.503780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645e0a-59f7-4072-b44c-4dd707e6f7af None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.529608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 265/530] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:25:51.530641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.538386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.539063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.539366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.539643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.540432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:51.540738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.542218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.560234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 266/531] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:51.561247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.631188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6168-e9f2-48f9-8d77-fde1f345ab53 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.662261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ff7a-1c7f-4754-9fa2-30f29278aae7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.665339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.666004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.666323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.666538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.667255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:51.667580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.669701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.681473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 266/532] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:51.682360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.697931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.698740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.699024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.699331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.710632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.712125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:51.729844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:51.731946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 267/533] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:51.733915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.782185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78be56-d592-41a0-8bfd-82c7715b9ce8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.814646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.815320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.815606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.815876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.816699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:51.817006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.818753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.825126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 267/534] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:51.825901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:51.849732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ed31-ed0e-4023-89c9-2ab6d72d8d04 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:51.922986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:51.925699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:51.925983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:51.926257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:51.947220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:51.947220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:51.971663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:51.972583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:51.973430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:51.976005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 268/535] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:51.982457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:52.025697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ea07-7373-4d19-960f-fd17b5a47955 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.083391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.083988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.084271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.084545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.085281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:52.085586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.086992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.100685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 268/536] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:52.108571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:52.145285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb60-e116-4a78-af0c-f10d437fe913 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.179673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.180701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.181181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.181652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.182625 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:52.183146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.185398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.198008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 269/537] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:52.204593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:52.215893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffc70-9f87-4287-a041-f63ed97efaaf None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.257710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.258505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.258788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.259064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.266698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.268200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:52.282063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:52.282923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:52.283780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 269/538] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:52.296302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:52.325208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fac11-9e79-4df1-ac90-ae824d57e191 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.359647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.360635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.361145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.361617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.362652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d48b44bd541f4b448ccd6ee0f060a011) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:52.363174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.364812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.371076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 270/539] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:52 2022] GET /identity/v3/role_assignments?user.id=d48b44bd541f4b448ccd6ee0f060a011&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:52.484975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce600216-acfe-47fa-bfb9-732d547e8de1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.545513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.546189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.546466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.546735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.547577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:52.547887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.549338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70191-a02a-46fa-8df8-2c38740cb80f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.577820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 270/540] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:52.583784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:52.744955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594da9-bf1d-414c-a76f-535c46b7bdbc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:52.782908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:52.783978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.784486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.784973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.785989 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=a37ec62dd1334df8b9870c43c609aac3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:52.786494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:52.788133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b748-7ffb-4b44-b3b0-68851fcb46f7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:52.794347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 271/541] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:52 2022] GET /identity/v3/role_assignments?user.id=a37ec62dd1334df8b9870c43c609aac3&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:52.906718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f46e-8821-465f-bb5c-5590a6bacee2 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.907420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f46e-8821-465f-bb5c-5590a6bacee2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.907904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f46e-8821-465f-bb5c-5590a6bacee2 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.909727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 271/542] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:52.915032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:52.915599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:52.916075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:52.933885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:52.935433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:53.006898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 272/543] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:53.038987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72f46e-8821-465f-bb5c-5590a6bacee2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.150200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72f46e-8821-465f-bb5c-5590a6bacee2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:53.185134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:53.186393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.186899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.187421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.198797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3c6bfc7e-5f93-430c-9916-fc15efede2f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:53.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:53.208646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:53.209472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:53.212480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 272/544] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:53.219301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.370977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae9a6-1c9b-4b49-a32f-d0803c1c3a08 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:53.420525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:53.421202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.421482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.421748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.422486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:53.422783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:53.424168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:53.439705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 273/545] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:53.445367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.445505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d286b-10a8-4456-8b76-8b8e7b1451e1 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.445708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d286b-10a8-4456-8b76-8b8e7b1451e1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.445990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d286b-10a8-4456-8b76-8b8e7b1451e1 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.447601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 273/546] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:53.453520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.453807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.454090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.480548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:53.481783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:53.555036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92557b71-8c56-4541-bb33-e1d36813302a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:53.611861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:53.612661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.612941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.613213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.628688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 274/547] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:25:53.629503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:53.631019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:53.648375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:53.649184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:53.650033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:53.650033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:53.650033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:53.650033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:53.650033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 274/548] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:53.656265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.667862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.821108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419b51-8d13-4448-88a0-421996d3f721 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:53.824363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c4776-373e-418d-87d6-fa8d36e93cf6 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:53.858325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:53.859365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.859871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.860333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.861247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:53.861743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:53.863330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:53.875718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 275/549] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:53.880135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:53.880135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:53.880135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:53.880135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:53.881455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.906398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:53.914343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:53.915209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:53.916007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 275/550] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:53.924280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:53.985083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694124a5-59f3-4d7d-953d-63562b5ee095 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.019227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.020412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.020889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.021379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.029313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.031015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.041272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed9181-cecc-4a1d-a812-83dd16b8dbca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:54.045956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:54.046811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:25:54.047718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:54.050179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 276/551] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:54.055627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.076488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.077175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.077460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.077735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.078477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:54.078782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.080163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.098998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 276/552] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:54.104291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.157819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae053b-02ff-4d45-9de2-0010b98346fb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.192916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.193950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.194497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.194977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.196035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:54.196532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.198137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.215890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 277/553] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:54.221460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.319898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fbf33-7ed4-440d-8fe3-6b7da1a2089e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.334995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64784f-1be7-4f48-8254-c2874908a7d2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.360386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.363288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.363288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.363288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.391423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.392228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.392506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.392776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.412682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.414068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:54.448743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:54.449730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:54.450900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:54.450900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:54.450900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:54.450900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:54.450900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 277/554] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:54.457781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.490690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.492320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.593523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 278/555] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:25:54.600522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.619085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6df68-7ad3-4c3c-9ae2-69fd74411548 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.653376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.654410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.654902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.655412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.656131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:54.656436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.657804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb562-8715-4542-a75b-fa3093ae982f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.675503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 278/556] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:54.677339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725df72-79c2-4f57-b86c-f201a622bcda None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.677627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725df72-79c2-4f57-b86c-f201a622bcda None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.677907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725df72-79c2-4f57-b86c-f201a622bcda None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.684488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 279/557] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:54.684488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725df72-79c2-4f57-b86c-f201a622bcda None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.735477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf513-0961-4e13-91f9-da5121c3546f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.768733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.769527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.769847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.770122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.780976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.782430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-350a9e70-fd15-403e-84b0-0ed4b50b71af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:54.799891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:54.800730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:54.801640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:54.801640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:54.801640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:54.801640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:54.801640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 279/558] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:54.803241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.803241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.803241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.809077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725df72-79c2-4f57-b86c-f201a622bcda None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:54.826915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:54.828447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:54.845143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:54.846250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:54.846767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:54.847249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:54.854847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:54.856638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:54.871821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:54.872746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:25:54.873633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:54.876162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 280/559] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:54.877277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:54.919325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 280/560] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:54.919325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.000801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7473eb-d8c5-4fc1-8c06-0bca7aff8a08 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.039617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.040308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.040590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.040914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.041644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.041947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.043361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.047308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db943334-9546-46b1-8df1-52cb6ab49adf None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.060526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 281/561] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.060526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.095251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.096329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.096799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.097258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.098727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.099243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.101566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.118386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 281/562] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:25:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.119186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.165413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0483352-a7a1-455a-b3ae-8c2d28e8e74f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.200385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.201265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.201573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.201849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.211860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c94478cd-794a-410f-9b9a-44288e196ad7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:55.219607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:55.220950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:55.221898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 282/563] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:55.222543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0607-2756-4695-95f9-1d8830e8133e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.222622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e002c-b68d-4015-bb2d-c72e408ed331 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.222622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e002c-b68d-4015-bb2d-c72e408ed331 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.222622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e002c-b68d-4015-bb2d-c72e408ed331 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.227868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 283/564] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:55.227868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e002c-b68d-4015-bb2d-c72e408ed331 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.267917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.268691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.269285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.269562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.278011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.279791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-da2c9e9f-1909-42fd-a1c4-fb9ab54835fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:55.297222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:55.298091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:55.299112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:55.299580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 282/565] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:55.300620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.300902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.301227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.323890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:55.326420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:55.331524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e002c-b68d-4015-bb2d-c72e408ed331 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.364621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.365409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.365687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.365958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.376824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.378249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:55.395406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:55.396721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:55.397562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:55.397562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:55.397562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:55.397562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:55.403646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 284/566] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:55.403646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.407415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 283/567] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:55.408336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.507941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399399b-3a52-4ea6-9f1a-955fddfc61d2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.510868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85bcbc-ff7e-4626-9578-95e8b7744ce0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.539049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.539670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.539951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.540222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.540945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.541249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.541840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.542488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.542575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.542765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.543036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.544351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.544655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.546064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.550559 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 285/568] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.551344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.560990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 284/569] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.560990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.644996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f0a4-2bc4-4ea8-a9fd-4c4e91378b74 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.649413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ea97d-c2aa-4982-ac7c-57e8e489780e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.676344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.677002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.677280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.677551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.678258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.678561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.679944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828020d-6f14-491a-860d-13eff72ae290 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.680044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.680800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.681076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.681345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.691574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:55.691709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 286/570] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.693203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25bb7-5adc-4ad9-8e8f-ae7e26e1fab7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.693490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25bb7-5adc-4ad9-8e8f-ae7e26e1fab7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.693762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25bb7-5adc-4ad9-8e8f-ae7e26e1fab7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.695130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 287/571] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:55.696805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25bb7-5adc-4ad9-8e8f-ae7e26e1fab7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:55.699764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:55.700822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:55.702079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 285/572] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:55.702752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.795256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25bb7-5adc-4ad9-8e8f-ae7e26e1fab7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.799021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b4d4-fda9-4011-8f73-0954612bb55c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.826922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.827747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.828012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.828282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.829996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.830628 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.830903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.831169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.832016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=179b4ae6970d49be8579745634c8ec67) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:55.832321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.833725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.837835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:55.839116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 286/573] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/role_assignments?user.id=179b4ae6970d49be8579745634c8ec67&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:55.839342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:55.840644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3b6f9564-f60f-45fe-9204-6cf0f890d001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:55.858284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:55.859543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:55.860436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:55.860436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:55.860436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:55.860436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:55.860436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 288/574] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:55.861118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.861290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.861658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:55.880015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:55.881244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:55.947466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8b9ed-b249-404e-aa4f-6e988aa4b87d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:55.950442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 289/575] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:55.952194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:55.991221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:55.992059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:55.992338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:55.992611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.000066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.001659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:56.017239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:56.018191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 287/576] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:56.019876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.066717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fa430-e467-4b64-86cb-2593b29c7fc8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.103455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.104383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.104665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.104928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.106499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.106806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.108174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.116762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 290/577] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.117470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.126307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea6c0-da36-4c60-9907-5310324d65e3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.161923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.162608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.162883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.163149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.163887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.164186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.165541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.177027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 288/578] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.177665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.217055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229de8d-f8ce-491a-8213-7989ebbc288d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.248600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.249390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.249664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.249930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.259679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:56.267763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:56.268737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:56.270094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:56.272474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684637-0b24-4818-998b-7cf6ea69eb39 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.273830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 291/579] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:56.274535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.306193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.307157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.307526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.307865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.308708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.309133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.310618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.323634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 289/580] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.325005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.374674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6774f-079c-46b6-b3f2-99a7eb4e5862 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.410021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.411557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.411855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.412119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.422010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5da2-2105-416d-b193-c4efa2d80ab5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.422733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.424260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:56.443639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:56.444527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 292/581] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:56.450784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.458215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.459006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.459307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.459592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.467173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.468929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:56.484198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:56.485291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:25:56.486406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:56.488331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 290/582] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:56.489197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.553537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50620bf-660e-4c12-b59d-6cf0efdcd4fe None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.587339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.587940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.588216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.588485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.589217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.589516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.590902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.591216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb0fb-752f-4d9d-9005-2cbf4293775e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.603360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 293/583] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.603360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.627410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.628301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.628578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.628847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/a776f52df1c944ed9b28524b7c582e0c/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.643854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=a776f52df1c944ed9b28524b7c582e0c, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.645295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.657460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 291/584] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:56 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/a776f52df1c944ed9b28524b7c582e0c/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:56.658262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.733409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0133c-4c70-459d-ad6c-da2f6dc5d514 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.772023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c185-24d7-4e5c-84f0-2ad974c27ddb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.784687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.785378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.785657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.785929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.786711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.787023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.788519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.802143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 294/585] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.802885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.821244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.822808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.823598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.824080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.825750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:56.826281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.828887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.852444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 292/586] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:56.854138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:56.914967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ef94d-bc3d-4745-93b4-f9b952dbc91b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.951905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:56.952877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:56.953053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:56.953321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:56.964485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:56.965969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:56.984678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1107e-f6fd-47e6-b2d3-586f40868d5d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:56.986370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:56.987241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:56.988375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:56.988375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:56.988375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:56.988375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:56.989139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 295/587] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:56.990200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.028425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.029736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.030189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.030617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.040170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.042497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:57.062706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:57.063751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:25:57.064659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:57.067573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 293/588] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:57.068749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.110305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186f8c-67a8-439c-8102-15176d4c500e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.153330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.154399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.154827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.155245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.165669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.177327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.177471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef04ce-716a-4a63-8620-a5cfb5cafb24 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:57.189017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:57.189949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:57.190876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:57.190876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:57.190876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:57.190876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:57.194509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 296/589] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:57.194509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.216562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.217680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.218002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.218437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.219311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.219779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.221726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.240272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 294/590] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.241183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.295904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16567e-b074-42fc-88db-bbf23e92a206 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.331232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.331994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.332361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.332693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.333534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.333885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.335455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.341014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3065c-33ce-4471-9337-7b81964fe2e1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.358207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 297/591] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.359099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.374381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.375056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.375355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.375627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.376340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.376639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.377991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.389951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 295/592] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.390765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.468426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d1bb-d617-4392-9bc1-5adec80b686a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.500555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4956b-fe4d-40c2-9faf-f191186a758c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.504790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.505597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.505878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.506153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.514117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.515652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:57.531361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:57.532349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:57.533285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 298/593] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:57.533878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.542037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.542901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.543231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.544061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.557194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.559501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:57.582859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:57.584801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:57.586147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:57.586147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:57.586147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:57.586147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:57.587357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 296/594] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:57.591287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.662356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5bd6-484d-41db-8182-60e197e8d5e8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.686341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14aa2e-0b60-462d-9ed5-0919de7eaef8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.705268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.706347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.706635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.706913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.716544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.718517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.723136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.723942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.724309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.724675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.725601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.725997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.727507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:57.733826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:57.735508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:57.737081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 299/595] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:57.743286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.755115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 297/596] 10.222.0.64 () {56 vars in 1139 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.756092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.849777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfccc5-f619-4705-ad82-785557588af1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.883252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869c9b7-776d-4e92-80a7-666c81dee3e7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:57.884407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.885192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.885572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.885943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.886792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.887745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.889323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.904619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 300/597] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.905654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:57.930703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:57.931660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:57.932088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:57.932529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:57.933968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:57.934424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:57.936597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:57.952295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 298/598] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:57.953353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.037221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2183e8-4740-4463-a755-3d5fcbc001ce None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.056222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fc2ce-dc08-428a-b558-653ef472d25e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.075829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.076948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.077395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.077825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.087678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.089276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.090081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.090873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.091151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.091454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.097865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.099308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-63d7e4b6-ebbb-4a51-a8df-fe249f2f99cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:58.107073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:58.108131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:58.109191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:58.109191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:58.109191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:58.109191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:58.115025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:58.115918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 299/599] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:58.116781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.117433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 301/600] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:58.119023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65de0a-1b99-4c0f-8a4c-b3cbe31ad997 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.119473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65de0a-1b99-4c0f-8a4c-b3cbe31ad997 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.119906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65de0a-1b99-4c0f-8a4c-b3cbe31ad997 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.122172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 302/601] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:58.122870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65de0a-1b99-4c0f-8a4c-b3cbe31ad997 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.223402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24bfb5-1629-4064-b8f9-381367c93fd4 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.224306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65de0a-1b99-4c0f-8a4c-b3cbe31ad997 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.256767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.257069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.257672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.257784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.257968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.258089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.258241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.258334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.258924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:58.259280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.260604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.272354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 303/602] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:58.273166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.274641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=d8526efe49fd469bb829106580483ea0, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.276896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce80d71-44c1-4fbe-9ca4-458159792758 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.289042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 300/603] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:58 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:58.300892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.301762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.302165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.326662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:58.328330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:58.396392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc57cf-602b-4c56-a406-fc21c5ff826f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.432882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 301/604] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:58.434009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.444496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.445475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.446351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.446819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.448222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:58.448987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.450874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.468612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 304/605] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:58.470266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.559387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79425b-84bc-4b77-8254-49bfbdc0af89 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.599233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.599455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa678-a849-4357-80a0-0d0efd6bb3e9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.600063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.600344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.600615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.609430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.611251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:25:58.632346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:58.633271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:25:58.634300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:58.634725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 302/606] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:58.636392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.642696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.643915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.644423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.644902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.658575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:58.669576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:58.670512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:58.671374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:58.674277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 305/607] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:58.675410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.753202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c7e7-0cdb-4ed9-a7e5-2ae0cfa1d451 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.789474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039fac-9d9d-43f3-9631-4617e48b9b27 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:58.795321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.796401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.796827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.797660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d48b44bd541f4b448ccd6ee0f060a011/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.814425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=d48b44bd541f4b448ccd6ee0f060a011, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.816009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.833345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:58.833737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 303/608] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:58 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d48b44bd541f4b448ccd6ee0f060a011/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:58.834084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:58.834383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:58.834630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:58.834987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.835615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:58.835966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:58.837484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:58.854067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 306/609] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:58.860673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:58.988783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e19fd1-12bf-4078-af11-b208ac8c5407 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.044327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.045243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.045514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.045778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/a37ec62dd1334df8b9870c43c609aac3/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.067139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738cc4-de4a-405b-9bc4-bef3f499008d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.068922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=a37ec62dd1334df8b9870c43c609aac3, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.070363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d876d-589d-4628-acb5-8d8ac12380c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.086790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 307/610] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:25:58 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/a37ec62dd1334df8b9870c43c609aac3/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:25:59.088081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60c48-3072-4338-b80f-6960fcdf6635 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.088367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60c48-3072-4338-b80f-6960fcdf6635 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.088640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f60c48-3072-4338-b80f-6960fcdf6635 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.091132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 308/611] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:25:59.097701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.097983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.098257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.112718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.113685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.114135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.114572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.115536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:59.116092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.117788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.118440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:25:59.119919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:25:59.128144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 304/612] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:59.136184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.198706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 309/613] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:25:59.223690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.257328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2abf-86fa-44ce-a375-fe6a8567c655 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.294184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.295226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.295603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.295964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.310487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.312644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:59.335657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:59.336639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:59.337932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:59.337932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:59.337932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:59.337932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:59.337932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 305/614] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:59.343920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.349529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3866-aa3b-48c3-b917-d7a6678af0d5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.391395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.398246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.398246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.398246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.440465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:25:59.448504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:59.450015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:59.451250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 310/615] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:25:59.458667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.460850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9a6c-d3aa-4337-abf7-57f52b050a2c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.496203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.496852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.497170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.497443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.498153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:59.498451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.500280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.514648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 306/616] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:59.519958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.581770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c03c6-99b1-492c-810d-6ce92852d6d1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.623756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.624434 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.624715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.625108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.625854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:59.626155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.627561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.632822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065f8e0-91d6-4f76-8d9c-9316f231f123 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.637152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 311/617] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:25:59.649666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.697537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.698362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.698634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.698964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.707714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.709170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:25:59.726307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:59.729194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:25:59.732840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 307/618] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:59.741103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.775041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f926e5b-ff1d-4cd8-91ac-260a6488764a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.809465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.810312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.810593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.810862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.822064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.823545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:25:59.842727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:25:59.844919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:25:59.847049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:25:59.847049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:25:59.847049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:25:59.847049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:25:59.847049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 312/619] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:25:59.849589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:25:59.889202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3e35-ec99-42ca-8d9f-0d39a3e14840 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:25:59.936016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:25:59.936695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:25:59.936975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:25:59.937246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:25:59.938093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:25:59.938398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:25:59.939854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:25:59.964518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 308/620] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:25:59.972247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.000468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f19d7-a1a4-4563-bf41-c8220dc42b55 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.035688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.036367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.036646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.036922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.037913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:00.038471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.040589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.054593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 313/621] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:00.060221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.121199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda765ea-8362-4d41-824b-25df6d190f17 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.156501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.157660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.158157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.158695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.181093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.184915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.212883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000ef24-3ab5-474e-8c9f-fd51602e3739 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:00.220392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:00.221341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:00.222206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:00.222206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:00.222206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:00.222206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:00.224377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 309/622] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:00.230417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.313016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.313826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.314114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.314422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.327114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.328594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.336233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db4a3-c6fc-4377-9f21-8eedc43c7e84 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:00.358719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:00.359816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 06:26:00.360730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:00.364041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 314/623] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:00.370155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.393395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.394396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.395066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.396724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.397929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:00.399179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.401560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.421434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 310/624] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:00.426824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.566776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe28-030a-4edb-b4cd-63221a49dd8d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.598343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e4654-e3c8-4de1-a73d-6a634e4f40a1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.620400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.621131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.621950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.622222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.623299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:00.623587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.627301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.645020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 315/625] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:00.650500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.670414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.671212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.671570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.671781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.684508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.685938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:00.705999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:00.706933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:00.707832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:00.711656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 311/626] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:00.712988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.816222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63167472-ab65-4f01-a5e7-3fc85b708162 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:00.856847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:00.857494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:00.857768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:00.858100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:00.858895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:00.861467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:00.862963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:00.883290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 312/627] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:00.888976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:00.959390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1a1f-8ebe-402d-be9c-de8690d15d6a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.032029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.032688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.032964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.033232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.052856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fecbb7-8b26-43d2-8701-cf529eab4294 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.130756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.131674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.131945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.132212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/179b4ae6970d49be8579745634c8ec67/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.161392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.162856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:01.164155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=179b4ae6970d49be8579745634c8ec67, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.165573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5255e2e-de99-45be-85e5-4d8b3015aed9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:01.194039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 313/628] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:00 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/179b4ae6970d49be8579745634c8ec67/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:01.203574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953abdf-533c-4a3c-85d4-3f83f9a4e5e4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.204000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953abdf-533c-4a3c-85d4-3f83f9a4e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.204283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953abdf-533c-4a3c-85d4-3f83f9a4e5e4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.207451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 314/629] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:01.219385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.219385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.219385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.254380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:01.255589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:01.411826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 316/630] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:26:01.413853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.422779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 315/631] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:26:01.449788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.576041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06224304-3410-4c69-8375-d2d6781b7fc4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.577140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcbcaa-ee6e-422d-a619-f3f01a214038 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.610016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.610804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.611081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.611375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.612932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.613997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.614485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.615003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.621616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.623072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:01.626639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-49153c5d-199f-4ea0-8f96-7b936715edf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:01.634798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:01.635744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:01.636572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:01.639861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 316/632] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:01.641256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:01.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:01.643518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:01.643518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:01.643518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:01.643518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:01.643518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 317/633] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:01.643980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87769-1f24-485e-b244-d8c3a80cf295 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.644575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87769-1f24-485e-b244-d8c3a80cf295 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.644975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87769-1f24-485e-b244-d8c3a80cf295 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.646670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 317/634] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:01.648265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f87769-1f24-485e-b244-d8c3a80cf295 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.648507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.773058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4d06-19b2-46c1-9e65-ad5398f4ee6c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.780599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f87769-1f24-485e-b244-d8c3a80cf295 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.816370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.817470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.818100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.818461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.819329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:01.819736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.821183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158527-4a3c-4aab-8499-3493ee4d3906 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:01.822009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.823034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.823817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.824335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.825782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:01.826338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.828445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:01.831587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 318/635] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:01.832994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.833377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.833747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.843414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 318/636] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:01.844594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.857362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:01.859309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:01.931051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 319/637] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:01.931792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:01.950013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865bcc-9074-41cf-b944-8319aa05032f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:01.984231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:01.985025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:01.985305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:01.985580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:01.995146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:01.997155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-6b67b3a4-e03e-4ef4-a833-cb8e5b4d261f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:02.016273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.017651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.018503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:02.018503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:02.018503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:02.018503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:02.018503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 319/638] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.024212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183a1e8-57ee-4f6c-a702-71d45aaee489 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.024212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183a1e8-57ee-4f6c-a702-71d45aaee489 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.024212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183a1e8-57ee-4f6c-a702-71d45aaee489 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.025544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 320/639] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:02.026544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183a1e8-57ee-4f6c-a702-71d45aaee489 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.048626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618e44b-cc61-479a-bfb4-b59be12b8cbc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.085853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.086570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.086842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.087108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.093645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.095043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:02.108394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.109325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:02.110186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 320/640] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.110676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.137705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183a1e8-57ee-4f6c-a702-71d45aaee489 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.172970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.173772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.174051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.174326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.184665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-972acaaf-bff5-4d14-a5d3-6cc03b675459 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:02.192351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.193634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:02.195050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 321/641] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.195802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.195802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.196014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.211752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:02.212928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:02.216807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd399d7-2bde-44a6-8f8c-8823568ff7b7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.249345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.249997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.250272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.250543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.251243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.251568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.252902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.268377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 321/642] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.268377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.280827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 322/643] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:02.288548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.367188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc8f4-218a-499c-8170-b9934decd705 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.388580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd9a5-71eb-49c7-b8ca-7de934eee8e4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.398969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.399650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.399928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.400191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.403650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.403650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.403650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.415725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 322/644] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.416517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.436591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.437342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.437531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.437800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.438546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.438844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.440230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.448708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 323/645] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.449520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.523624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10cf4d-d051-4bf3-a609-72234e7ef2c0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.551930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d93ba7-ac11-4a05-b7cd-512289915c6b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.560613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.561618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.562046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.562455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.570299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.571839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.584744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.585542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.585820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.586091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:02.586609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.587761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 323/646] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.588760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.602764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:02.611113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.612174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:02.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 324/647] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.613682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.695536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a91f3-6766-4325-a461-1daeb7c77355 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.710280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bafd7-9954-478e-9364-00dca3a48d98 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.729576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.730223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.730523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.731389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.732208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=a776f52df1c944ed9b28524b7c582e0c) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.732511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.733977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.739746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 324/648] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/role_assignments?user.id=a776f52df1c944ed9b28524b7c582e0c&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.740300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.752750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.754299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.754821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.755334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.771436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.774137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:02.798298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:02.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:02.800654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:02.800654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:02.800654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:02.800654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:02.803309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 325/649] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:02.804795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.850616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7567-a77d-4a79-afb6-f9bd82d33690 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.886378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.887358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.887756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.888166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.889120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.889524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.891056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.914933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 325/650] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.916100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:02.936961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b2d8-bc7e-4209-80a9-6c13ae4cfa06 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:02.976471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:02.976471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:02.976471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:02.976785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:02.977316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:02.977613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:02.979426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:02.988115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 326/651] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:02.989196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.043778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6de90-7d5f-4f04-acdd-2009025d64a8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.084972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.085940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.086424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.086926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.087868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:03.088428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.090596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.102509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 326/652] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:03.103652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.113454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443cd2f-ea02-4dad-a34a-8a4ca66520c9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.156793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.157425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.157701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.157976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.210147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0289a3-2317-4a72-bdaa-729c76626e7d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.241968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.243360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.244834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.245874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.246405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.246903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.258151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.259962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:03.278838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:03.279765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:03.280623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:03.280623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:03.280623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:03.280623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:03.286875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 327/653] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:03.287954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.344402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 327/654] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:26:03.345254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.392826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a955-49fb-4ab0-8840-912395ded631 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.431423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.432324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.432670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.433003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.442526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.444364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.457549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7534-9b5a-49e6-9c1a-43b98f084f29 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:03.459887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:03.460986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:26:03.462127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:03.463570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 328/655] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:03.463715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.497271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.498065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.499135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.499459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.500267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:03.500576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.502204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.518852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 328/656] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:03.519971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.571294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b9fa3-71a6-4f7a-b4e8-6ede80b12076 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.613087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.613883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.614159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.614428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.626310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.627784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.628597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee021-b75d-4151-82e5-aef89ce81970 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:03.645046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:03.645955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:03.646819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:03.646819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:03.646819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:03.646819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:03.646819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 329/657] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:03.647561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.668652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.669326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.669597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.669866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.670699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:03.671000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.672447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e386e6-9df7-44fc-9cac-290228055214 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.689648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 329/658] 10.222.0.64 () {56 vars in 1137 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:03.690919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff722-7777-4d81-8ad0-50c8e2d45075 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.691202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff722-7777-4d81-8ad0-50c8e2d45075 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.691499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff722-7777-4d81-8ad0-50c8e2d45075 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.695334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 330/659] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:03.695334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff722-7777-4d81-8ad0-50c8e2d45075 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.752003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b224b9-b218-4ba1-81f5-753d6fb83a97 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.783587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.784378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.784657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.784928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.791299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afff722-7777-4d81-8ad0-50c8e2d45075 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.792268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.794645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:03.808189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:03.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 06:26:03.810590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:03.814306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 330/660] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:03.815083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.826341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.826999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.827305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.827587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.828303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:03.828605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:03.829977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129a1a-8780-4c1a-a188-0b6304fa9c2b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:03.841025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 331/661] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:03.842217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.842502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.842777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:03.858502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:03.859720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:03.914935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283d816-fa9a-475a-adbb-21d856c2b7e3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:03.925855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 332/662] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:03.926690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:03.959373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:03.960033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:03.960316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:03.960587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.024455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe78dc-9867-47c9-8cda-b80064a340be None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.027059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.028563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.057605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.058268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.058543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.059411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.060237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:04.060541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.061968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.079290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 333/663] 10.222.0.64 () {56 vars in 1139 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:04.080016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.134762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 331/664] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:26:04.134762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.180845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd6f5-d3c3-449c-afb7-b9ab9df05d8f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.212921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.214008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.214437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.215383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.222060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.223678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.226765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5100c3-4b7b-4a2d-8203-a236fced23c5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:04.238202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:04.239109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 334/665] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:04.244873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.262054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.262847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.263128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.263444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.273401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:04.281711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:04.282626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 332/666] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:04.288703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.338731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857a7a-eb2e-4be2-97c1-c9233f4e7372 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.370474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.371165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.371485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.371771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.379853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b5e5-71e6-4c1e-963f-7a99e10efc2a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.412160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.412954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.413235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.413503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.424529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.425946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.437217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.438675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:04.443626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:04.444504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:04.445369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:04.445369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:04.445369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:04.445369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:04.445369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 333/667] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:04.446148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.535238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 335/668] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:26:04.536152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.552469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcb0-6321-4a91-873b-629e93ccd6e5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.584754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.585540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.585820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.586090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.586863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:04.587171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.588602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.605965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 334/669] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:04.605965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.632240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56bd4-aff7-4ae2-927e-9cee96df50cd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.665438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.666106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.666384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.666656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.667460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:04.667764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.669162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.676953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 336/670] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:04.677736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.707451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9f27b-45bc-4573-905e-167e17b9dec4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.740995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.742066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.742553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.743061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.743998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:04.744501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.746026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.762158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 335/671] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:04.763717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.776189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797276f-fc54-48cb-af93-4ac6fffe9891 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.809664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.810376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.810653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.810918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.821739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.823182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:04.840359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:04.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:04.842552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:04.842552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:04.842552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:04.842552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:04.846100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 337/672] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:04.846935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.866085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7746eb-cea8-4c92-94c7-76304ba2ff0f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:04.901881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:04.902605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:04.902884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:04.903155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:04.904017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:04.904401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:04.905732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:04.919577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 336/673] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:04.919577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:04.968460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76007-9f06-468e-947e-db807a870f89 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.015438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.016252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.016533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.017344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.032875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadafef-28c5-4e8b-a8e7-0bbc861aa3c9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.035438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.037197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:05.054957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:05.056117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:05.057179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:05.057179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:05.057179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:05.057179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:05.063789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 338/674] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:05.065067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.079357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.080843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.081543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.081969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.091780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.093943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:05.111937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:05.112917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:05.113973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 337/675] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:05.114544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.187211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b85b-57b9-424e-8ff4-bd06517e7401 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.220089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.220751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.221028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.221296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.222009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.222311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.223720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03657e7e-1bd0-4a9c-89b8-6bc3f16c954b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.225254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ea77-403c-43fe-bd84-d8e0c6e4106a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 339/676] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bf42-ef5b-4385-ba8f-f37d8db83791 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bf42-ef5b-4385-ba8f-f37d8db83791 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bf42-ef5b-4385-ba8f-f37d8db83791 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 340/677] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:05.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6bf42-ef5b-4385-ba8f-f37d8db83791 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.263924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.264619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.264905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.265179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.265897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.266261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.267589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.278767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 338/678] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:05.279616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.341816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6bf42-ef5b-4385-ba8f-f37d8db83791 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.376044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.376705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.376994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.377266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.378046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.378354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.379822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b34fb-9034-4d7d-84f4-77f44875a1d8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.380581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2d11d-42f4-48b2-b9ff-edde850ceb04 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.391210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 341/679] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:05.396177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662363-f237-4919-b349-67e960eb1a65 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.396177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662363-f237-4919-b349-67e960eb1a65 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.396177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662363-f237-4919-b349-67e960eb1a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.409797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-47662363-f237-4919-b349-67e960eb1a65 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:05.410866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-47662363-f237-4919-b349-67e960eb1a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:05.414274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.415074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.415391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.415669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.422717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.424198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:05.439529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:05.440397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:05.441303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:05.443573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 339/680] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:05.444772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.477258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 342/681] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:05.478615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662363-f237-4919-b349-67e960eb1a65 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.543405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421e04-78a4-48cb-ad5b-f180040699e9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.574478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662363-f237-4919-b349-67e960eb1a65 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.576701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.577501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.577778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.578047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.584957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.586387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:05.601355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:05.602290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 340/682] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:05.603866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.612731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.613379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.613666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.613947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.614774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d48b44bd541f4b448ccd6ee0f060a011) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.615089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.616570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.622887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 343/683] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/role_assignments?user.id=d48b44bd541f4b448ccd6ee0f060a011&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:05.623773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.718714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fcfe8-6e70-4f44-92c2-da95fc08d7e8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.756484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.758053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.758681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.759243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.760416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.761253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.763458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.767735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c69b29-ee8c-43ec-bcc7-47ec9b65bc35 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.780572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 341/684] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:05.782001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.811689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.812962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.813344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.813892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.828926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.830407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:05.849836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:05.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 344/685] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:05.852622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:05.922739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa1d8-38e6-4404-92e3-374edaf73b5f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.967238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d12b6-c04b-4698-9e76-802a48d9cabd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:05.968757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:05.970423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:05.970920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:05.971437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:05.972612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:05.973168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:05.975228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:05.999546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 342/686] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:06.000687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.001156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.001399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.001682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.001952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.002889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=a37ec62dd1334df8b9870c43c609aac3) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:06.003202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.004755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.011174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 345/687] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/role_assignments?user.id=a37ec62dd1334df8b9870c43c609aac3&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:06.012673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.118930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa853c-99ed-43c8-abc3-93f3b6d0d135 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.137941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a7b35-903d-4de5-8dc8-240fcc224ee7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.155473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.156197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.156477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.156750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.184263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.185578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.186238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.187071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.188363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:06.188898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.191389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.218056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 343/688] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:06.223466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.258925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.266896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.373227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73160d-f099-4370-b8d0-97c3ab0ce70e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.390930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 346/689] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:26:06.396207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.415836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.416832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.417209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.417580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.418613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.420257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.441847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 344/690] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:26:06 2022] POST /identity/v3/users => generated 254 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:06.511834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19442-68cf-407e-8dc0-28a5057a6584 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.549579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.550539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.550914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.551295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.563202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.564840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:06.585446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:06.586596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:06.587697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:06.587697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:06.587697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:06.587697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:06.589274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 347/691] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:06.596164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.703830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5521c1-0247-4acb-ada9-635b78e88b9f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.742661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.743521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.743900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.744269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.745092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:06.745493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.747543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.764780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 345/692] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:06.769866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:06.869273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fe02-06eb-4a5a-82a5-dfc97777fff1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:06.905236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:06.906049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:06.906330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:06.906603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:06.915257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:06.916721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:06.933630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:06.936181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:06.938334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:06.939998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 348/693] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:06.941418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:07.057673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2986176-c429-4336-9d1b-42e4086c1ad5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:07.107932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:07.108597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.108875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.109146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.109926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:07.110226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:07.111667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5954411-409c-4c2d-a3bc-245b7e5ab887 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:07.131112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 346/694] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:07.136873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:07.290659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e9ec-898d-4d59-8db1-966d64415840 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:07.337037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:07.337617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.337895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.338166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.338998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=179b4ae6970d49be8579745634c8ec67) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:07.339329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:07.341325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58506562-7d5f-49a1-83c7-05463cb451f3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:07.351981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 349/695] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:07 2022] GET /identity/v3/role_assignments?user.id=179b4ae6970d49be8579745634c8ec67&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:07.375413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bd2b-c0d7-460b-ad05-80323a21201c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.375818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bd2b-c0d7-460b-ad05-80323a21201c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.375958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bd2b-c0d7-460b-ad05-80323a21201c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.377533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 347/696] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:07.382831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.383116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.383431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.401155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:07.402874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:07.472797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 350/697] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:07.496503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5bd2b-c0d7-460b-ad05-80323a21201c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:07.631499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5bd2b-c0d7-460b-ad05-80323a21201c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:07.671940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:07.672798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.673084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.673355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.684176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:07.691976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:07.693145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:07.694203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 348/698] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:07.700826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:07.806224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b873ef-d7f6-49f9-978b-5ddf2c66f830 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:07.841924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:07.842974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:07.843489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:07.843962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:07.844952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:07.845466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:07.847035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:07.857148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 351/699] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:07.862218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:07.970538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593e6b6-5f31-4ab7-8c0b-221dd28009af None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.012907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.013704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.013976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.014245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.033151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.034586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:08.053869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:08.054736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:08.056138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:08.056138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:08.056138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:08.056138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:08.056138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 349/700] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:08.060862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.231043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e9e1-17f7-4cb8-8eae-6bd8ca8c5de4 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.287501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.288176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.288458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.288736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.289459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:08.289766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.291140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f89fc-fd75-4f15-96fa-03c67a8e2c82 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.308473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 352/701] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:08.314428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.365773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a493-0da7-4eb4-8234-1d0a13a89532 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.366099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a493-0da7-4eb4-8234-1d0a13a89532 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.366337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172a493-0da7-4eb4-8234-1d0a13a89532 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.368050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 353/702] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:08.378020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.378020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.378020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.396612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:08.398201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:08.475533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 354/703] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 06:26:08.482781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582b6f4-9206-4a96-a643-b63494dce21b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.491511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.548950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.549756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.550032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.550299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.563395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.564834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:08.594045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:08.595025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:08.596002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:08.596521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc243b-b9eb-48d0-a2ba-cebc2dd092a0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.598675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 350/704] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:08.603670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.645700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.646512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.646791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.647063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.647743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.649103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:08.680552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:08.681554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:08.682380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:08.687594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 355/705] 10.222.0.64 () {56 vars in 1129 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:08.693853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.784886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec565d-5236-4097-b7ce-f1261a736374 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.851088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.851801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.852082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.852353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.853197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:08.853503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.855048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.870861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b737-8f31-492d-a1cb-0bacf4647e71 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:08.875060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 351/706] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:08.880481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:08.912693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:08.913364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:08.913696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:08.913967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:08.914719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:08.915025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:08.916437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:08.926056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 356/707] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:08.927224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.019477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002959-a80d-413a-baa6-f2d1e3138c10 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.048735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35662e-5704-4f63-b8ec-0f36e8fbd12f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.058056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.059392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.059672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.063302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.114865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.115958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.116472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.116972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.117881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:09.118392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.119989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efa5f-ec51-4867-aad4-2e6d5bc99f19 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.126558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 357/708] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:09.128341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55166e-e293-40a0-bc39-a219df912a4a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.128876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55166e-e293-40a0-bc39-a219df912a4a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.129361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55166e-e293-40a0-bc39-a219df912a4a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.135385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 358/709] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:09.137186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d713-cf81-4473-bda5-658608334b5d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.137720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d713-cf81-4473-bda5-658608334b5d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.138233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d713-cf81-4473-bda5-658608334b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.152636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.154100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.157128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3096d713-cf81-4473-bda5-658608334b5d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:09.158637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3096d713-cf81-4473-bda5-658608334b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:09.313492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 359/710] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:09.336445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096d713-cf81-4473-bda5-658608334b5d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.345880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 352/711] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:26:09.351199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.493223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096d713-cf81-4473-bda5-658608334b5d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.499800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245e91-be5e-4366-a6ab-6c1f44082a6f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.533897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.534700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.534979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.535249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.553886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.555364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.569224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.569953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.570237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.570504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] PATH_INFO: `/v3/services/network` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.571157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.572562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-4d43fbcf-7cf6-445a-b025-99ca038ce7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:09.576792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:09.577713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 353/712] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:09.579739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174933a6-1e79-4972-bd59-9e8c7b95f61c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.580104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174933a6-1e79-4972-bd59-9e8c7b95f61c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.580689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174933a6-1e79-4972-bd59-9e8c7b95f61c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.582056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 354/713] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:09.583062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174933a6-1e79-4972-bd59-9e8c7b95f61c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1e812a65-520c-4fa6-ab38-9265ad309dd9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:09.588266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:09.589292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:09.592415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:09.595319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 360/714] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:09.596159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.596444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.599296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.614317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:09.615528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:09.687554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 361/715] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:09.688609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.690025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174933a6-1e79-4972-bd59-9e8c7b95f61c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.726368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.727034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.727343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.727668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.728387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:09.728745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.730105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.742572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 355/716] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:09.745103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.805925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0976c5-ffa0-4848-a3c0-23e3b3201fab None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.841579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.842531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.842996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.843499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.844380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] RBAC: Adding query filter params (name=network) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:09.844488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dbbcf-c2d7-479f-923e-e9e9fb594030 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.844983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:09.846534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:09.855600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 362/717] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:09.856681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.880686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:09.881493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:09.881771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:09.882092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:09.896472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:09.907489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:09.908471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:09.909296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 356/718] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:09.909968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:09.964274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9647-169b-4cb1-bdb9-981862f5576b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:09.999476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.000582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.001045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.001536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.008618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.010424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:10.025106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:10.026024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:10.026888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:10.029892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 363/719] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:10.030931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.036717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25c14-7a5c-475e-9492-e0aed857b6f9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.079871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.080600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.080888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.081162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.082032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] RBAC: Adding query filter params (type=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:10.082338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.084052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.093480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 357/720] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:10.095193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.180311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2900ff-57f0-4210-97ee-929c4ca314e9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.249276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.250300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.250763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.251229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.252295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:10.252784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.254358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.270304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 364/721] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:10.281248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.306054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c515-5c64-4383-b32f-a2de130a405b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.359310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.359913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.360193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.360467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.361253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:10.361559 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.364537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.382054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 358/722] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:10.386930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.426700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c3fb-06dc-4b14-9432-767051eb7e9e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.469057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.470069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.470399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.470679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.484643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.486430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.507183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173254-d62a-4183-a4d8-5e0f2293c48f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-584b52bb-bcf8-4e84-8efe-fd9078b17855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:10.508056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:10.508921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:10.509990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:10.509990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:10.509990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:10.509990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:10.509990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 365/723] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:10.510847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2a7-c321-4325-9f33-95d78b81182f None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.511130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2a7-c321-4325-9f33-95d78b81182f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.511428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d2a7-c321-4325-9f33-95d78b81182f None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.518593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 366/724] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:10.518593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d2a7-c321-4325-9f33-95d78b81182f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.559740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.560482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.560761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.561033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.561868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:10.562181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.564143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de07b1-8b4d-4cb3-ab07-f85282bb26d6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.572690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 359/725] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:10.575047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.575444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.575724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.598758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:10.599999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:10.641850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d2a7-c321-4325-9f33-95d78b81182f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.721694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 360/726] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:10.728138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.728836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.729169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.729448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.730187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:10.730533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.731950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:10.744897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 367/727] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:10.747536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.759691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:10.919836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738296-4f73-4f79-a615-2d1e00915890 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.923376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2163a3-3b50-4cbe-a412-6294baf065aa None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:10.982041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.983226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.983750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.984241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.987648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:10.989407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:10.991940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:10.992429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:10.997314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:10.999760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:11.022118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:11.023091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:11.024053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:11.025637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:11.033605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:11.034514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:11.035370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:11.036703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 368/728] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:11.040985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 361/729] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:11.044245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.044661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.188790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3d1dc-9abe-4606-b5d3-d6b8b7129663 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.221982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21cb9-e774-495e-9d30-a46eb60c4e3c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.254866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.255932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.256438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.256929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.257972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:11.258475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.260119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.287833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.288868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.289352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.289843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.290777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:11.291297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.293400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.296518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 369/730] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:11.304165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.319499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 362/731] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:11.333062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.470156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8bb9-24ee-4603-ba1f-a1b10297101e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.517158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.517917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.518119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.518380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.523127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee898-5a4d-4b6d-9861-92b63910f764 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.557739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.559087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.559411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.559679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.571294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.572743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:11.589523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:11.590945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:11.591889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:11.591889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:11.591889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:11.591889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:11.591889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 363/732] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:11.600221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.630446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.631935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fff73-2bd8-4606-a7ed-99f6167a5724 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.730384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 370/733] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 06:26:11.731726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643edd-29ac-4abb-baab-864637d818f8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.732012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643edd-29ac-4abb-baab-864637d818f8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.732290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4643edd-29ac-4abb-baab-864637d818f8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.733779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 371/734] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:11.738322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4643edd-29ac-4abb-baab-864637d818f8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.751251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aae46-d570-4f8a-a12a-dcf8b8499fa1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.784382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.785095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.785377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.785699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.786410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:11.786709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.788154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2e49-f46b-4257-aa28-db8953c30210 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.800406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 364/735] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:11.801686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.801968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.802292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.819221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:11.820309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:11.840008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4643edd-29ac-4abb-baab-864637d818f8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:11.875508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:11.876340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:11.876616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:11.876889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:11.892441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:11.893939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:11.895201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 365/736] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:11.896076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:11.926364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:11.928570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:11.930718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:11.930718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:11.930718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:11.930718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:11.934799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 372/737] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:11.936123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.013350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7ccc7-d523-44c8-a884-e8d04c6f4aa3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.044266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162119fb-9442-4b2c-b53e-bf135f17c5c9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.048330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.049126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.049406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.049683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.057068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.059114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:12.074142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:12.076427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 366/738] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:12.078599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.086636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.087337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.088942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.088942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.095687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.095687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.123352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 373/739] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:11 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:12.123352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.244123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec96d30-0f36-4d7e-af2a-a6c4c6bae1a1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.258388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165dd1e-25b9-4ff5-bd31-d4fc51913dae None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.284355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.285254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.285649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.286045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.287499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:12.287898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.289626 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.312109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 374/740] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:12.318562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.337824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.338768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.339194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.340156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.341023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:12.341477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.342988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.374385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 367/741] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:12.380257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.461747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b55d-1c5a-4ecc-9d24-28e44ef02325 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.502249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.502892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.503166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.503729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.564950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b41b-45bf-42ad-b783-c7fba5f69110 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.591944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.593772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132544d8-664b-4262-acdc-96d460385bb7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.601222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.602038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.602321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.602599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.610284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.611753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:12.626097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:12.627125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:12.628675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 368/742] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:12.640518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.727365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 375/743] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 06:26:12.729081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45046de-1098-4463-b4bb-907328360e7d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.729364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45046de-1098-4463-b4bb-907328360e7d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.729635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45046de-1098-4463-b4bb-907328360e7d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.733065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 376/744] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:12.733824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45046de-1098-4463-b4bb-907328360e7d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.795766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca18f3-bb83-4179-822f-194db634df73 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.835148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.836191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.836704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.837177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.838172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:12.838683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.840918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f24b-aa0c-44f3-8472-06907804e701 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.841787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45046de-1098-4463-b4bb-907328360e7d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:12.854402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 369/745] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:12.856119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.856616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.857413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.874259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:12.875602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:12.877020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612843-620f-4954-8906-26686043a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:12.878019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612843-620f-4954-8906-26686043a947 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:12.878479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612843-620f-4954-8906-26686043a947 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:12.878937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612843-620f-4954-8906-26686043a947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:12.890138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612843-620f-4954-8906-26686043a947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:12.891904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612843-620f-4954-8906-26686043a947 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-dd612843-620f-4954-8906-26686043a947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:12.910229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:12.911159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:12.912164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:12.912164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:12.912164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:12.912164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:12.913807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 377/746] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:12.914810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612843-620f-4954-8906-26686043a947 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:12.955289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 370/747] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 06:26:12.955289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.037877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612843-620f-4954-8906-26686043a947 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.057061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060485-67ec-4723-b704-1d21ac140b70 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.071859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.072508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.072789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.073053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.073895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=59f12c409d534a7a8937a1875d421c4d) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:13.074761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.076193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.081471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 378/748] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/role_assignments?user.id=59f12c409d534a7a8937a1875d421c4d&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:13.082219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.104652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.105951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.106446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.107378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.108609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:13.109073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.111188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0baac3-75ac-4f54-8b52-4a556fd0f08e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.127240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 371/749] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:13.129976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f440-b372-4887-adf5-f9affd41c6d3 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.130457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f440-b372-4887-adf5-f9affd41c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.130871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f440-b372-4887-adf5-f9affd41c6d3 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.137558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 372/750] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:13.137558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f440-b372-4887-adf5-f9affd41c6d3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.200092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583030-5854-4884-bf32-4edb8aa24171 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.243295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.243295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.243295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.243295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.243681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.243681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10e85-e37c-4b3a-81f0-4f9b225a69e0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.259967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 379/751] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:13 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:13.261454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.262336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.262623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.283493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:13.284841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:13.302229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f440-b372-4887-adf5-f9affd41c6d3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.343099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.344017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.344682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.344682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.352804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.354302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.366875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 380/752] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:13.370396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:13.372049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:13.372923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 373/753] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:13.377556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.439742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.496993 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dce59-8e37-4a20-86ef-6d88027492ad None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.534411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.536044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.536318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.536584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.537364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:13.537666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.539099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.551850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 381/754] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:13.557149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.585224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faeeea-51b5-40ef-aa3e-0f1e7e6e3a4a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.623942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.625007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.625431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.625842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.638574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:13.646764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:13.647851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:13.648758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:13.651679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 374/755] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:13.657360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.781154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751cd05-284f-4bc1-9eff-24dafe1fa50a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.828676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574928-c868-4b0c-b203-da5cbcf35a62 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:13.860120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.861165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.861622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.862065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.863001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:13.863500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.866532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.880472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 375/756] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:13.886052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:13.910009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:13.911246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:13.911556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:13.911828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:13.912991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=179b4ae6970d49be8579745634c8ec67) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:13.913305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:13.914770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:13.930510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 382/757] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/role_assignments?user.id=179b4ae6970d49be8579745634c8ec67&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:14.043361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b9317-292c-4f11-af6b-2a9de0cd49a5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:14.091083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:14.092732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:14.093191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:14.093637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:14.105860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:14.107681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:14.139128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:14.140082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:14.140962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:14.140962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:14.140962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:14.140962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:14.143116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 376/758] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:14.152484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:14.288469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c941-87cb-4c88-999a-5f7e034c18dd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:14.321646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:14.322312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:14.322596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:14.322870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:14.323623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:14.323959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:14.325325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:14.337185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 383/759] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:14.342678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:14.471069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75ab5-0e58-49a2-afda-3d194bf830fb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:14.518992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:14.519827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:14.520105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:14.520377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:14.529997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:14.531776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:14.549795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:14.550769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:14.551743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:14.554352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 377/760] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:14.560289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:14.716002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b8e0-fd99-413e-8363-361fc3ed735d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:14.762718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:14.763816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:14.764320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:14.764795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:14.765843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:14.766353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:14.768003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a1cd0-69c1-40c7-ab47-504fc53d4984 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:14.787600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 384/761] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:14.793377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:14.947291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e812a-a066-427c-924f-bde2ef997c36 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:14.997341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:14.998126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:14.998412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:14.998687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.012868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.014333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:15.039101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:15.040124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:15.041019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:15.041019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:15.041019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:15.041019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:15.041235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 378/762] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:15.053753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.056776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af291e8-10be-4ef5-8f01-6bc309dada72 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.057561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af291e8-10be-4ef5-8f01-6bc309dada72 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.058065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af291e8-10be-4ef5-8f01-6bc309dada72 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.060867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 385/763] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:15.068743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.069623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.070123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.103990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:15.105211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:15.225995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451264-96e6-4ecd-93e5-66c201438ed0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.239302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 386/764] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:15.270883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.271511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.271795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.272070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.272838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:15.273151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.274565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.286727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.292494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 379/765] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:15.299928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.474793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151dfb-05c8-4cfd-b9fc-b71fe69ebb5a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.494865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088cca1-eecd-4624-9e7b-5a89a288fce7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.517317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.518492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.518999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.519658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.521722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.524127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:15.543634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:15.544601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:15.545419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:15.548306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 387/766] 10.222.0.64 () {56 vars in 1129 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:15.554260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.560851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.561659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.561933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.562199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.580033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.581499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:15.604183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:15.605195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:15.606081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 380/767] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:15.613422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.711069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653790e0-ee15-4bd6-8226-9f0051b3d9c2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.729042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bb61c-588c-4692-aec6-68db86fb9518 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.756774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.758544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.759032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.760623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.761665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:15.763819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.765585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.787076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 381/768] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:15.790564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.791327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.791813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.792328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.793371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.794286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:15.794774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.796409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b446410-a681-4626-8503-4e9ec02fe871 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.801738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 388/769] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:15.807624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b20c4-1c9b-4979-a556-32f271cf0980 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.808271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b20c4-1c9b-4979-a556-32f271cf0980 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.809252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b20c4-1c9b-4979-a556-32f271cf0980 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.810920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 389/770] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:15.811904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b20c4-1c9b-4979-a556-32f271cf0980 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.906615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5f6c-bc84-4b21-8bf7-cf71bb758e40 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.917127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b20c4-1c9b-4979-a556-32f271cf0980 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:15.950505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.951696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.952127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.952536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.953048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:15.953894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.954267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.954768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.955359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=d8526efe49fd469bb829106580483ea0, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.955700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:15.956137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:15.957254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.957711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff2ad3-fd31-4897-a5ad-892ee135d349 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:15.963030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 390/771] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:15.967865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:15.967865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:15.967865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:15.978138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 382/772] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:15 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:26:15.979762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:15.987401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:15.989103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:16.080552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 391/773] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:16.115929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.130646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14baf4f-dfe6-416f-82bb-b8d03b7b75a7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.205793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.206557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.206841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.207116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.207946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] RBAC: Adding query filter params (interface=public, service_id=92db465aca1343d6844b0ed2d0a6370b, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:16.208258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.209643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad201c-0ff6-4017-833f-4d0be1f53692 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.221687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 383/774] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:15 2022] GET /identity/v3/endpoints?service_id=92db465aca1343d6844b0ed2d0a6370b&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:16.225746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e66-84de-4362-b12c-161253653a85 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.226039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e66-84de-4362-b12c-161253653a85 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.226570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e66-84de-4362-b12c-161253653a85 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.228011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 384/775] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:16.228723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170e66-84de-4362-b12c-161253653a85 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.267809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c072a-9c19-4b5a-9959-1e29239c9200 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.302850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.303673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.303947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.304214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.314645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d6c83ec2-57e6-49a1-85b9-b0fa18ca5ddd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:16.322681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:16.323639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:16.324505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 392/776] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:16.325678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.325850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.331354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.340963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170e66-84de-4362-b12c-161253653a85 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.347847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:16.349018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:16.375880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.376601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.376882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.377154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.377827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.379290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.384820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 385/777] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:16.385754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.417071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 393/778] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:16.440075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.503636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993310a3-e7bb-4461-b858-58a5d078d187 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.539379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661496f2-914f-433b-be50-965da085d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.540065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661496f2-914f-433b-be50-965da085d362 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.540343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661496f2-914f-433b-be50-965da085d362 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.540613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661496f2-914f-433b-be50-965da085d362 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.541428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661496f2-914f-433b-be50-965da085d362 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:16.541729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661496f2-914f-433b-be50-965da085d362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.543297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661496f2-914f-433b-be50-965da085d362 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.544907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749c7b-1f16-4e08-b00f-8ea7e3486feb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.552604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 386/779] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:16.560551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661496f2-914f-433b-be50-965da085d362 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.586766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.587554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.587822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.588288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] PATH_INFO: `/v3/services/network` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.588961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.590988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:16.607923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:16.609802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:16.610862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:16.613191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 394/780] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:16.621048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.737138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661496f2-914f-433b-be50-965da085d362 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.775165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.776013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.776289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.776647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.778219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4e3c-9bef-4828-a998-1db203a9934a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.788607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.790131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:16.813529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:16.814723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:16.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:16.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:16.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:16.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:16.815939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 387/781] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:16.819978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.821999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.823223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.826091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.826525 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.829004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] RBAC: Adding query filter params (name=network) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:16.829487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.831038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.836510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 395/782] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:16.850545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:16.937150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127687ca-b70f-4e95-82d5-486941732658 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:16.971670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:16.972340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:16.972617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:16.972886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:16.973603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:16.973904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:16.975349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:16.988306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 388/783] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:16.993595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.089321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c7ab3-1240-4b6d-802d-4d7778a1583d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.106974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb1f1-628a-4b71-9af0-8b989b41c7f4 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.124209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.124965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.125314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.125656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.126481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] RBAC: Adding query filter params (type=network) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:17.126848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.128446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9b99-5900-4941-b4f4-d84f7b52c006 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.134199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 396/784] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:17.140358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f645c-05ad-4bb6-9e32-7fb16235ea76 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.140703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f645c-05ad-4bb6-9e32-7fb16235ea76 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.141192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f645c-05ad-4bb6-9e32-7fb16235ea76 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.142659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 397/785] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:17.143468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f645c-05ad-4bb6-9e32-7fb16235ea76 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.155531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.159390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.159884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.160177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.168800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.170317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0dd5ef9e-e12c-49eb-b5a1-47c91cc26bf1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:17.190406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:17.191455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:17.192572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:17.195361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 389/786] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:17.196845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.199711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.200152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.218924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:17.220156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:17.275333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f645c-05ad-4bb6-9e32-7fb16235ea76 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.306164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 390/787] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:17.307085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.318694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.319472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.319752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.320066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.321248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] RBAC: Adding query filter params (interface=public, service_id=82250b748a4d46209731a7053d26679f, region_id=RegionOne) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:17.321566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.325089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.335554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 398/788] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/endpoints?service_id=82250b748a4d46209731a7053d26679f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:17.336521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.440694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467fc9-d703-4e4b-9953-e54ee804c4a8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.461431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84ab3a-2150-48c4-8863-2b9923d775ca None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.476806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.477634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.478039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.478419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.479392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:17.479803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.481342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.500859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.501651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.501928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.502199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.503902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 391/789] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:17.504983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.515126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:17.524980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:17.526257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 399/790] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:17.528880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.606643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa274203-e521-4304-8baa-ff5f07617c77 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.640334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.641090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.641461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.641804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.642555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.644007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.651204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324419a-a4d3-4aaa-b0d1-61aee6fee4b9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.654754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 392/791] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/services => generated 772 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:17.655852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.692093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.693099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.693371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.693633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.721233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.722729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:17.764642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:17.767832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 400/792] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:17.772025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.831126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45953e-4f5c-47d9-99b7-4a8b989c41c6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.873337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.874395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.874881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.875402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:17.876352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:17.876891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:17.878468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:17.890844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 393/793] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:17.896087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:17.950445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b547c8-4e7f-4029-9430-95f27e83e132 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:17.998165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:17.999005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:17.999431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:17.999729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.000460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:18.000768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.002142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.016283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3249-b8e8-4bb7-b0c3-8fe7c490bdef None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.016555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 401/794] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:18.021897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.060175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.060982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.061264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.061536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.076650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.078418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:18.104987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:18.106988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:18.109356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:18.109356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:18.109356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:18.109356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:18.109356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 394/795] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:18.114491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.166813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6879b-4a9e-472c-ab73-5975dd3715b7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.241656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.241656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.241656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.241656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.257347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.258812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:18.285693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:18.287779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:18.290850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:18.296551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 402/796] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:18.297588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.498854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eef53-049c-4ff9-b032-aae34919391f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.527816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f56d16-0cb8-44d9-b886-f0e33aae3781 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.553884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.554542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.554818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.555086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.555893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:18.556195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.557610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82ee3-e45c-4bd1-9e73-cd6fa50371b1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.562424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.563102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.563414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.563689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.564406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:18.564707 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.566068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b910d-08cb-462b-b655-d28bd2c43394 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.570700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 403/797] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:18.572032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18b3e-35b9-4575-9991-9e70f543415e None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.572309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18b3e-35b9-4575-9991-9e70f543415e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.572578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18b3e-35b9-4575-9991-9e70f543415e None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.574046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 404/798] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:18.577261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18b3e-35b9-4575-9991-9e70f543415e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.583498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 395/799] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:18.584792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.585083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.585360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.604184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:18.605899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:18.673405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 396/800] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:18.674372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.685544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18b3e-35b9-4575-9991-9e70f543415e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.720859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.722163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.722649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.723128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/59f12c409d534a7a8937a1875d421c4d/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.738340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=59f12c409d534a7a8937a1875d421c4d, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.740158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.756146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 405/801] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:18 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/59f12c409d534a7a8937a1875d421c4d/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:18.757569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.792968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37977a21-0b39-4331-b2eb-7e4f784fa3d5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:18.835926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:18.837100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:18.837634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:18.838220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:18.847422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:18.850164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:18.869023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:18.870034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:18.871586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:18.879443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 397/802] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:18.881873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:18.997244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733268-c317-4fb2-a3d1-5138e518c57b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.030648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4417-055f-4ba4-9230-f686af609891 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.051066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.051901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.052178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.052447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.073335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:19.081411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:19.082288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:19.083106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.091815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.092749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.093225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.093716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.094757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:19.095254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.096863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.099747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 406/803] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:19.105123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.127876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 398/804] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:26:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:19.134581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.255637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4243d-21bb-4d54-b9dd-f3c253702216 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.269730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591e5ee-ea76-49c8-ba0b-6ea9893e1ace None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.297977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.299115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.299556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.299835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.300758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:19.301387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.303227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5014a49-8ce9-45dd-bf2c-b3179a54001d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.309462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.310612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.310977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.311345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.312663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 407/805] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:19.314488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13332ff-a26f-4679-976d-8aa83ddf5e16 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.314782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13332ff-a26f-4679-976d-8aa83ddf5e16 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.315061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13332ff-a26f-4679-976d-8aa83ddf5e16 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.317317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 408/806] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:19.318296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13332ff-a26f-4679-976d-8aa83ddf5e16 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.331677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.333626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-3f611f56-7265-45be-a133-01aa2de8c557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:19.356953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:19.357876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:19.358754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:19.358754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:19.358754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:19.358754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:19.358754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 399/807] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:19.360633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.360911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.362485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.379851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:19.381315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:19.453948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13332ff-a26f-4679-976d-8aa83ddf5e16 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.463347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 400/808] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:19.464547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.504337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.505524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.506064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.506651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.519546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.521313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:19.540533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:19.541448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:19.542354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:19.542354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:19.542354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:19.542354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.544646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 409/809] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:19.545693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.588306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e660e1-0be7-43c5-9a43-e446d98d0936 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.631850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.632891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.633378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.633893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.634821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:19.635365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.637509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.654580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea91b7-a8f4-442c-a229-93428ad0b9b9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.654915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 401/810] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:19.656064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.685310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.686167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.686439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.686707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.687368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.688722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:19.701768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:19.702765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 06:26:19.703647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.707416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 410/811] 10.222.0.64 () {56 vars in 1129 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:19.708262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.765155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef1797-3237-46bb-b8b2-7f18eaa10b7d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.801299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.802310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.802798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.803355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.804274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:19.804781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.806332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.806922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6476e1-2046-4c36-85be-cdc710f926b5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.819679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 402/812] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:19.820761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.842261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.843024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.843322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.843597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.850609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.852121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:19.866255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:19.867179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:19.868376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:19.872684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 411/813] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:19.873465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:19.929868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb028f6-53dc-465b-9032-17192122185b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.965996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:19.967026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:19.967544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:19.968047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:19.968974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:19.969515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:19.971085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:19.972064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3cfa1-0289-4b8d-81ec-ee6c7f6dd7a2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:19.978329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 403/814] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:19.979590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.018514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.020309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.020929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.021697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.031545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.033012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:20.051670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:20.052649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:20.053568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 412/815] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:20.054154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.102199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149604e3-6a1f-4901-ac2d-979adbb0ef79 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.138023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.138704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.138981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.139252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.140089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:20.140394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.141858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.154949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 404/816] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:20.156017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.163644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bed79-2283-465a-b268-4770b8a49d18 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.199521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.200231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.200505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.200773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.201509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:20.201855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.203211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.212840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 413/817] 10.222.0.64 () {56 vars in 1124 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:20.213659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.256649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b996-4fcd-4606-9372-3bc038e55425 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.295161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.295884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.296167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.296439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.297272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:20.297578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.298984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.316055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1a75a-b145-401e-beaa-3c8784d10a93 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.322624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 405/818] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:20.323522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.350256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1963614-36a6-4404-919d-350595743d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.351135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963614-36a6-4404-919d-350595743d69 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.351437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963614-36a6-4404-919d-350595743d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.351699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963614-36a6-4404-919d-350595743d69 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/179b4ae6970d49be8579745634c8ec67/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.353666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1963614-36a6-4404-919d-350595743d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=179b4ae6970d49be8579745634c8ec67, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.355788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1963614-36a6-4404-919d-350595743d69 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.368015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 414/819] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:20 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/179b4ae6970d49be8579745634c8ec67/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:20.368864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1963614-36a6-4404-919d-350595743d69 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.448264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f47df0-104c-401b-b1a7-fd2d818bcef5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.482895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1963614-36a6-4404-919d-350595743d69 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.499375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.500207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.500627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.500996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.501940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.503473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493bee6-f8a5-4eb9-be89-c2af455e018e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.529521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.530437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.530918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.531431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.535800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 406/820] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:20.537762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963739c4-9636-43c9-8fc4-6eea1b4e6f1f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.539447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963739c4-9636-43c9-8fc4-6eea1b4e6f1f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.539990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963739c4-9636-43c9-8fc4-6eea1b4e6f1f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.547627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 407/821] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:20.553665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.554266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.554741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.573578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:20.575196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:20.625059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.626536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.656898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 408/822] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:20.680943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.739405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 415/823] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:20.741524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.786292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355a6e-ea97-4b2d-aaa4-a129e518b86c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.832385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.833553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.834337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.834790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] PATH_INFO: `/v3/services/network` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.835972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.837925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:20.854189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:20.856088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:20.857507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 409/824] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:20.866045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.869057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ddae6-a0be-4287-9db0-cbca00702e58 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:20.904860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:20.905580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:20.905857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:20.906125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:20.917573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:20.919544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:20.938002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:20.938915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:20.939816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:20.939816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:20.939816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:20.939816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:20.943441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 416/825] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:20.945209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:20.974174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60132f-3a09-4289-8bb8-ccf4bd2df729 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.008171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.009235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.009713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.010183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.011105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] RBAC: Adding query filter params (name=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.012164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.013776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.019039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 410/826] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:21.024634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.049194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ee3d-f203-4e00-8669-edd2ae354ece None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.086991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.087688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.087967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.088238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.089063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.089282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.091193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.107356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 417/827] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:21.108577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.137039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827929a-15b4-4961-9fc1-42f1e7a7e011 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.170979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.172005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.172462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.172972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.173859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] RBAC: Adding query filter params (type=network) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.174352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.175920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.181285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 411/828] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:21.186863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.211411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75308-7065-499e-81a7-e90f735e6025 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.240864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.241663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.241940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.242210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.249238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.250697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:21.265551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:21.266536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:21.267418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:21.271470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 418/829] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:21.272638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.357517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9305-3dac-48eb-aa4c-39afae05f4a5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.380286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f16a-15ea-4c31-934d-a57918f0b84b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.393401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.394296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.394750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.395187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.396102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.397679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799263b6-b4c9-48e7-b48a-36ed0f771135 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.419289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.419289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.419289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.419289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.419730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.419730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.421086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849d100-c025-4176-9362-243e5000ce54 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.429659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 412/830] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:21.439359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0512c-af60-4737-97cc-4738045f8900 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.439359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0512c-af60-4737-97cc-4738045f8900 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.439359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0512c-af60-4737-97cc-4738045f8900 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.439675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 419/832] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:21.439779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 413/832] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:21.440055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.440346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.440623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.445261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0512c-af60-4737-97cc-4738045f8900 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.461056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:21.462288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:21.559374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 420/833] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:21.601443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.609826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0512c-af60-4737-97cc-4738045f8900 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.651596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.652538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.652969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.653389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.654839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.655360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.657301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.666967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 414/834] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:21.724730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b9466-4a24-4fb1-81b9-5c25d75b9139 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.772707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.773818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.774250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.774672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.788990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:21.798151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:21.799420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:26:21.800489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:21.803175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 421/835] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:21.811780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:21.920654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081ba2-7d4c-4afd-819f-7e246c840081 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:21.955009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:21.955717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:21.955999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:21.956330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:21.957079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:21.957379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:21.958737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:21.967176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 415/836] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:21.972434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:22.071394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a428-3b6b-4809-b6f8-f599a422c422 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:22.108148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:22.109265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.109751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.110223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.120942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:22.122633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:22.139402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:22.140292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:22.141182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:22.141182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:22.141182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:22.141182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:22.143326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 422/837] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:22.149040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:22.248423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc170669-5ab3-43cb-be07-4a59c20db2ba None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:22.283705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:22.284367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.284639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.284907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.285622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:22.285920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:22.287292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:22.299859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 416/838] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:22.305169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:22.407865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e356-d811-4bb5-ac94-aa2276f17145 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:22.442097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:22.443173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.443476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.443748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.451840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:22.453279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:22.468405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:22.469386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:22.470316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 423/839] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:22.475496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:22.575862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a026-34cc-435a-a986-ed121145823a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:22.610102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:22.610770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.611047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.611342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.612165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:22.612463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:22.613859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac752393-0303-4ffe-8cc2-31fd130cf4f6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:22.631313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 417/840] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:22.636953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:22.742001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9233f2-de14-4a5e-8122-cd8e01e2fa82 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:22.777992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:22.778646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.778924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.779196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.846317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:22.847798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:22.912006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed21-a07b-4890-8378-1fec0c117c15 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.912552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed21-a07b-4890-8378-1fec0c117c15 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.912552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed21-a07b-4890-8378-1fec0c117c15 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.914959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 418/841] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:22.918901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:22.919186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:22.919490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:22.936217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:22.937734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:22.956586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 424/842] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:22.965879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.015454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 419/843] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:23.032089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.083503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c79a-ef18-4237-a9f1-0f514beea8fc None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.122121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.123202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.123642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.124059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.134004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.135635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.141372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404ba29-ba07-44b0-a79a-5b97408823b6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:23.153573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:23.154627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:23.155706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:23.155706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:23.155706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:23.155706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:23.161697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 425/844] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:23.162766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.178764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.179982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.180264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.180537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.194325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:23.203755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:23.204669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:23.205493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:23.207339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 420/845] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:23.212147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.282443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aef9f-5f3a-4b07-a611-329acd4a22c4 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.323824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdf91a-b7eb-4ee9-a4e6-4c43534b32e9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.325472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.326335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.326820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.327339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.328297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:23.328793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.330341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.341954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 426/846] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:23.348728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.358709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.359369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.359652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.359923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.360666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:23.360969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.362322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.375900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 421/847] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:23.377410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.471456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e08d-6b23-438b-a87a-c33f4c2d45a7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.498772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939af22-fd5c-444f-9f2f-5f69b45521fd None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.507017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.508108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.508388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.508660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.515548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.516990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a9695107-cc6c-4a71-be6a-ddec5965112b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:23.531133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:23.532087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:23.533578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 427/848] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:23.534192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974171-3687-4bde-95f5-53b395b5125f None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.534439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974171-3687-4bde-95f5-53b395b5125f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.534712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974171-3687-4bde-95f5-53b395b5125f None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.536149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 428/849] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:23.538991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.539823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.540194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.540357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.541005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b974171-3687-4bde-95f5-53b395b5125f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.551907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.553339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0f78a734-7644-4c0b-b3a5-4816fd3ba6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:23.571013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:23.572059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:23.573022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:23.573022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:23.573022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:23.573022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:23.573022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 422/850] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:23.573981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.574262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.574536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.592859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:23.594024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:23.652533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b974171-3687-4bde-95f5-53b395b5125f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.660760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 423/851] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:23.661674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.691611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.692518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.693052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.693375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.694184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:23.694402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.695852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.707771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 429/852] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:23.708958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.762955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cb9df-6792-4811-8b50-54c1e03e1500 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.796486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.797072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.797351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.797624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.798335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:23.798634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.800007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.806055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea5ef0-9a64-4a14-a535-131431ae1ff0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.810705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 424/853] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:23.811695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.841323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.842126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.842401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.842674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.843342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.844697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:23.857389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:23.858372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:23.859197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 430/854] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:23.860472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:23.920992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7b87-99e5-4fa3-9d2e-6b745510f76a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.954215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:23.954864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:23.955144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:23.955461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:23.956283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=59f12c409d534a7a8937a1875d421c4d) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:23.956593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:23.957996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:23.962197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c460717-3a46-4011-9c4c-fc14b4d40565 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:23.963717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 425/855] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/role_assignments?user.id=59f12c409d534a7a8937a1875d421c4d&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:23.965056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.016347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.017508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.017970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.018413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.032766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.034819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:24.051791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:24.052778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:24.054068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 431/856] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:24.062546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.081992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f096a9f-b782-401c-9cdd-95fbf7e40627 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.117140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.117818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.118097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.118368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.119074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:24.119409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.120837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f611cc-3ef8-4b26-8328-2ea4e16f1984 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.130083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 426/857] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:24.130083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984bbf-1ede-4857-b06f-ac20d0da387a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.130083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984bbf-1ede-4857-b06f-ac20d0da387a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.130083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984bbf-1ede-4857-b06f-ac20d0da387a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.130083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 427/858] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:24.133656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984bbf-1ede-4857-b06f-ac20d0da387a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.178050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269750f-e24c-4005-bc17-2270376fb0b5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.213038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.213962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.214079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.214323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.215723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:24.216237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.217814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826419c-ddec-407b-8612-f356391f89ad None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.238465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 432/859] 10.222.0.64 () {56 vars in 1135 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:24.244001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.244295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.244573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.245952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984bbf-1ede-4857-b06f-ac20d0da387a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.264124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:24.265700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:24.278930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.279619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.279928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.280167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.280854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:24.281152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.282486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.286926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 428/860] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:24.287727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.356141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 433/861] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:24.378771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.408411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639c53-0768-44b9-887e-060dfb804fb5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.445674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.446514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.446892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.447259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.490399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf5717-6086-4ea5-a701-8f9489b1bd85 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.529206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.530016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.530300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.530553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.531208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.532598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.541402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.543157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:24.545460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:24.546364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:24.547226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 434/862] 10.222.0.64 () {56 vars in 1132 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:24.555256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.651579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 429/863] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:24.656686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.679771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128e6d-11fc-480f-b237-8e4afeedecb2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.713735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.714657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.714772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.714954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.715698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:24.715997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.717355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.722180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 435/864] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:24.731373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.769267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39e244-b9fb-492e-9e0a-581c4c2b5368 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.814411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.815386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.815763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.816128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.829463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.831026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.843850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88312965-c1de-4725-bad9-59c76c0baf28 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:24.853407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:24.854298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:24.855971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:24.855971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:24.855971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:24.855971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:24.855971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 430/865] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:24.860550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:24.894138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:24.894818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:24.895102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:24.895711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:24.896705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:24.897016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:24.898395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:24.904825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 436/866] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:24.975997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdae35-f07b-4677-9ad6-c681cf7fc99d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:25.016217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:25.017333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:25.017813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:25.018281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:25.019232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:25.019759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:25.021367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:25.035336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 431/867] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:25.040512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:25.143770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee00ee-21c6-46ca-bacf-a26662df5f20 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:25.177588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:25.178306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:25.178827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:25.178827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:25.185646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:25.187103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:25.201593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:25.202572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:25.203719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 437/868] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:25.208913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:25.312995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97457b-881e-43e8-beb7-ad162b1d07c7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:25.347096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:25.348068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:25.348522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:25.348962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:25.349911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:25.350412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:25.352007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69d7a-b665-4c34-9563-9cab60711fc3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:25.364956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 432/869] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:25.370801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:25.472094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204eeba-8f41-4596-af78-32ddc92f2f45 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:25.505933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:25.506660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:25.506986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:25.507335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:25.508540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=179b4ae6970d49be8579745634c8ec67) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:25.508973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:25.510590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b8a4b-da46-4455-b7d4-d36cc2cc2f49 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:25.517877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 438/870] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:25 2022] GET /identity/v3/role_assignments?user.id=179b4ae6970d49be8579745634c8ec67&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:26.328074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff6b4-09b5-40df-bcb4-1950786fdd29 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.328622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff6b4-09b5-40df-bcb4-1950786fdd29 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.328702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff6b4-09b5-40df-bcb4-1950786fdd29 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.330248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 433/871] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:26.335598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12251-fcac-4d47-acd7-6b0b95a3a116 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.335979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12251-fcac-4d47-acd7-6b0b95a3a116 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.336159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12251-fcac-4d47-acd7-6b0b95a3a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.353665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-44b12251-fcac-4d47-acd7-6b0b95a3a116 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:26.354331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-44b12251-fcac-4d47-acd7-6b0b95a3a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:26.425130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 439/872] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:26.448772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff6b4-09b5-40df-bcb4-1950786fdd29 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:26.550247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff6b4-09b5-40df-bcb4-1950786fdd29 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:26.583211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b80d9-939d-4768-b3f5-80a5b09a79d1 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.583449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b80d9-939d-4768-b3f5-80a5b09a79d1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.583727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b80d9-939d-4768-b3f5-80a5b09a79d1 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.585321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 440/873] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:26.586557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:26.591120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.591120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.591120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.592901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.593445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.593811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.602106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:26.611204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:26.612332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:26.613346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:26.614705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:26.615905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 434/874] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:26.619775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:26.621227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:26.699791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 441/875] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:26.722164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:26.749955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf42a8a-3a9b-4bb5-93d8-455f3510a26a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:26.788663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:26.789342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.789623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.789894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.790635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:26.790943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:26.792395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:26.805818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 435/876] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:26.806825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:26.854601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927627c-8735-4847-a4f6-efdf93430a03 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:26.901328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:26.902580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.903024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.903319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.904551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:26.906265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:26.922930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864ba-fe8f-4ed7-a9da-86eded43468c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:26.924114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 442/877] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:26 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:26.970527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:26.971381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:26.971666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:26.971993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:26.985432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:26.986940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:27.007299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:27.008263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:27.009123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:27.009123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:27.009123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:27.009123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:27.009123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 436/878] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:27.016041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.132463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960855e-212a-4285-a928-c0c678c858e0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:27.167642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:27.168629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.168629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.168921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.169578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:27.169882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:27.171247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc07d-5d2b-43b8-b77e-c33e5a1e2258 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.183207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 443/879] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:27.188479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.188902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc456-0389-44d9-a483-45e9fc0f2a63 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.189241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc456-0389-44d9-a483-45e9fc0f2a63 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.189569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc456-0389-44d9-a483-45e9fc0f2a63 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.191058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 444/880] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:27.197899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.198181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.198457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.220430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:27.222261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:27.292529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068568-a01f-4346-8cfa-57856245bc5d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:27.305968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 445/881] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:27.329774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.348201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:27.349018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.349291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.349556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.361000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:27.363467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:27.381104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:27.382081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:27.383040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:27.385676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 437/882] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:27.392321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.444061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5757d8-c757-4a7a-936d-ef655dc356fe None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:27.479447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:27.480603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.481110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.481581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.482515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:27.484128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.494208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412d39c-213a-4a87-88cf-4dfa4274c4bb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:27.501733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 446/883] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:27 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:27.544987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:27.545672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.545950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.546222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.547070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:27.547406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:27.548971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0d6e8-50a6-4680-9768-0f9728ba38f2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.570874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 438/884] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:27.577271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.684035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678963-9248-4a66-814f-1864df67bcca None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:27.722535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2502-784f-437a-8170-72047cc29503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:27.723201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2502-784f-437a-8170-72047cc29503 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.723541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2502-784f-437a-8170-72047cc29503 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.723817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2502-784f-437a-8170-72047cc29503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.796187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d2502-784f-437a-8170-72047cc29503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:27.797630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d2502-784f-437a-8170-72047cc29503 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:27.882786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1250cc-d669-4b09-9ad1-b4e0855b7bfe None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.883111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1250cc-d669-4b09-9ad1-b4e0855b7bfe None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.883347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1250cc-d669-4b09-9ad1-b4e0855b7bfe None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.884936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 439/885] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:27.890015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:27.890319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:27.890570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:27.897668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 447/886] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:27 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:27.904959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2502-784f-437a-8170-72047cc29503 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:27.911528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:27.912945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:27.993243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 440/887] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:28.016319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.026746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2502-784f-437a-8170-72047cc29503 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.069899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.071521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.072352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.072842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.086339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.088043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:28.111519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:28.112473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:28.113358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:28.113358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:28.113358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:28.113358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:28.116366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 448/888] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:28.118677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92b7a-a6d8-4fdf-aa17-2aaac4ba6908 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.121815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.163644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.164819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.165323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.166231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.167105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.169927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:28.184991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:28.186008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:28.186810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:28.189427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 441/889] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:28.195830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.234765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76676828-722a-4f39-ad14-4bf42b928a32 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.271732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.272324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.272600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.272938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.273577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:28.273880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.275245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.292092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 449/890] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:28.293653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.330533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a3da1-7671-4aa7-9133-083b511f4246 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.375705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.377495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.377932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.378353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.379201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:28.379668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.381643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.388801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 442/891] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:28.393922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.396106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b4a3-15c0-471c-8a99-753fabe9289b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.433194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.433991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.434269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.434547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.441930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.443828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:28.459135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:28.460642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:28.461614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:28.467286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 450/892] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:28.468213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.519401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8896df-01af-43d7-a8c0-c1ff208cf1aa None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.563327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.564575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.565065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.565647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.567076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:28.567593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.569259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef593-158e-4746-91c9-a570cebf4e6e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.569598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.584370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 443/893] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:28.613387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.614114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.614448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.614730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.615619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:28.615932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.617392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3377c-f0c6-4aee-97ab-b1e41025966f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.630560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 451/894] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:28.637272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:28.742511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9800-99bf-4210-af6e-5c28adf92561 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:28.780566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:28.781242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:28.781524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:28.781795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:28.782636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] RBAC: Adding query filter params (role.id=a2357736f6f041249ba5d6aea39f242a, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=59f12c409d534a7a8937a1875d421c4d) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:28.782946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:28.784433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a6d44-95d5-43d4-9c36-056178ccd19e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:28.790960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 444/895] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:28 2022] GET /identity/v3/role_assignments?user.id=59f12c409d534a7a8937a1875d421c4d&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=a2357736f6f041249ba5d6aea39f242a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:29.263498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e50-0f46-44e9-84dc-445f76d8bb37 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.263876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e50-0f46-44e9-84dc-445f76d8bb37 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.264077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e50-0f46-44e9-84dc-445f76d8bb37 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.265571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 452/896] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:29.270955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399580-966d-4243-86b5-96fd93ded04a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.271506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399580-966d-4243-86b5-96fd93ded04a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.272006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399580-966d-4243-86b5-96fd93ded04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.288695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-41399580-966d-4243-86b5-96fd93ded04a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:29.290163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-41399580-966d-4243-86b5-96fd93ded04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:29.359195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 445/897] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:29.381954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa56e50-0f46-44e9-84dc-445f76d8bb37 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:29.489794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa56e50-0f46-44e9-84dc-445f76d8bb37 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:29.524316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:29.525039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.525320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.525588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.526230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:29.527637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:29.539232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:29.540221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:29.541046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 453/898] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:29.548931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399580-966d-4243-86b5-96fd93ded04a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:29.656081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399580-966d-4243-86b5-96fd93ded04a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:29.695077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:29.696139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.696638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.697118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.698034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:29.698578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:29.700168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:29.705358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 446/899] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:29.711188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:29.822853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37ffc6-e280-48dd-b4ee-abb688b0068f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:29.856658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:29.857319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.857595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.857862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.858557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:29.858854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:29.860283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e00a62-cb42-4f2a-975f-2490a061d05c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:29.865465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 454/900] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:29.871087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:29.935739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2517e-7d9c-4d6f-970f-17168b2e0b16 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.936085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2517e-7d9c-4d6f-970f-17168b2e0b16 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.936289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2517e-7d9c-4d6f-970f-17168b2e0b16 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.938050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 455/901] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:29.944040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:29.944334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:29.944587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:29.961543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:29.962766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:29.982093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8a1c-45c6-4caf-94db-f815fae1c8fc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.016612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.017614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.018113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.018591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.019704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] RBAC: Adding query filter params (interface=public, service_id=5032126d5dd5436baf6275a2344a84a2, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:30.020256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.021804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.028052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 447/902] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:29 2022] GET /identity/v3/endpoints?service_id=5032126d5dd5436baf6275a2344a84a2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:30.033524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.033875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 456/903] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:30.055417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.134568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caada0-3ebe-4a45-ba79-96de52b74f74 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.150716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0908da-779d-45c9-9a5c-fcdf71fdc9aa None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.169939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.170985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.171523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.172011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.172886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.174443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.187393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 448/904] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:26:30.190792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.191731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.192013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.192282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.193202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.194607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:30.208524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:30.209599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:30.210502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 457/905] 10.222.0.64 () {56 vars in 1132 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:30.216800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.327186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68265f97-e0db-4f5d-a1e5-4c9b1de7922c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.370176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.371825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.372330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.372800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.373729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:30.374246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.375881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.381880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 449/906] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:30.388737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.497335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580f92b-83ef-461b-b0a0-d59f3e7b7ff5 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.532197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.532922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.533197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.533466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.534203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:30.534508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.535891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.540953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 458/907] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:30.546628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.653362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367eb4-b226-4dd7-8018-fa2595fdc7bb None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.692567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.693934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.694436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.694923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.695995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] RBAC: Adding query filter params (interface=public, service_id=7f152c5e384c46e7a9aa4e14846ecefd, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:30.696544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.698191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548009ad-2e72-4b86-8c6f-a7ef2f2a62c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.704877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 450/908] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/endpoints?service_id=7f152c5e384c46e7a9aa4e14846ecefd&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:30.710138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:30.811435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b044acf-804e-4a02-a0a4-57e45c797084 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:30.844509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:30.845178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.845457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.845727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.846401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:30.847798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d3ae1-7307-467e-925e-a371194caa70 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:30.853796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 459/909] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:30 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:26:30.885507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78c02a-ae6b-44c5-aa65-8566354ec46b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.885845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78c02a-ae6b-44c5-aa65-8566354ec46b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.886114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78c02a-ae6b-44c5-aa65-8566354ec46b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.887984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 451/910] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:30.894180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993232-01e4-4e38-9ed3-92c06008b6fd None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:30.894499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993232-01e4-4e38-9ed3-92c06008b6fd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:30.894744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78993232-01e4-4e38-9ed3-92c06008b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:30.913472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-78993232-01e4-4e38-9ed3-92c06008b6fd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:30.914630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-78993232-01e4-4e38-9ed3-92c06008b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:30.990975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 460/911] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:31.013804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78c02a-ae6b-44c5-aa65-8566354ec46b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:31.102810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce30b-d645-47d1-9005-4bae33d2cf76 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.103256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce30b-d645-47d1-9005-4bae33d2cf76 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.103624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce30b-d645-47d1-9005-4bae33d2cf76 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.105998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 461/912] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:31.111575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.111928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.112276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.125995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78c02a-ae6b-44c5-aa65-8566354ec46b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:31.132178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:31.133454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:31.162230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:31.163256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.163867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.164332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.165412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:31.167843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:31.184054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 452/913] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:31 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:31.211051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 462/914] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:31.240314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:31.360934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8818f-ddd8-4404-bc5a-68ac633eafff None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:31.395365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:31.396127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.396404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.396674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.411307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:31.420667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:31.421641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:31.422746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 453/915] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:31.428695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:31.531125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31316d-4763-4cb5-a2b7-a4aa4466da50 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:31.565380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:31.566416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.566898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.567413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.568706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:31.569251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:31.570812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:31.580444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 463/916] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:31.585864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:31.695517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d269b9-00cd-4001-b84f-ee5f7b9f9d36 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:31.730185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:31.731040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.731349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.731624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.742876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:31.744344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:31.762405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:31.763408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:31.764737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:31.764737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:31.764737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:31.764737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:31.764737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 454/917] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:31.769533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:31.869857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e0c9-fc3f-47b8-b37a-242997582dc9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:31.903223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:31.904221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:31.904702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:31.905170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:31.906074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:31.906598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:31.908188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:31.920825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 464/918] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:31.925917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.028582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5aa4f-feed-452a-866c-a984eed25033 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.064876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.065738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.066065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.066341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.074624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.076087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:32.091558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:32.092543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:32.093893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 455/919] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:32.098735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.196485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad4fed-3f2c-4d9d-9452-77d62dc7a6e8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.230066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.230825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.231115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.231416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.232247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:32.232552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.233984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.254712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 465/920] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:32.259882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.360055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70174898-4952-40dd-bfa0-e8e328a6e934 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.397352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.398165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.398443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.398716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.410363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.411840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5971abe6-5ba4-4199-bbf4-8e2917d5bdfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:32.429893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:32.430712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:32.435645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:32.435645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:32.435645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:32.435645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:32.435645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 456/921] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:32.437576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.539459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e280-8c8d-4f64-ae1b-bbbde5c284f6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.567250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666abb8-beca-4c21-8c07-6a4d88b8866d None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.567565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666abb8-beca-4c21-8c07-6a4d88b8866d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.568096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666abb8-beca-4c21-8c07-6a4d88b8866d None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.569744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 457/922] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:32.574639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.574941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.575192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.576109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.576775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.577055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.577329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.578051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:32.578354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.579761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.592484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 466/923] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:32.592749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:32.593840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:32.600823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.662642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 458/924] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:32.685332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.701914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d47db-5729-4c8b-8106-ee56fecf21c8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.735790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.736860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.737287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.738127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.748161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.749821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:32.770368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:32.771512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:32.772622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:32.780778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 467/925] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:32.781441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.795986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294a5b-0e36-44f8-8029-caf0279f9ce1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.843348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.844413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.844839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.845263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.846203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.848602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:32.864133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:32.865367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 06:26:32.866398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:32.869129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 459/926] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:32.876061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.888564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460b4ea-06fa-4244-b15f-48d4fc4fbd0a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:32.928418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:32.929401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:32.930206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:32.930756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:32.932424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:32.933516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:32.935942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:32.957807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 468/927] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:32.959911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:32.997026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70c10-a2e7-48b2-a5c9-cfa57576d315 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.045090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.045793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.046085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.046364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.047074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:33.047411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.048779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.059516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 460/928] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:33.060416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.089105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0337-bca5-4e96-9760-c409cbb5ae42 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.124860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.126147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.126632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.127122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/59f12c409d534a7a8937a1875d421c4d/roles/a2357736f6f041249ba5d6aea39f242a` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.129711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=59f12c409d534a7a8937a1875d421c4d, role_id=a2357736f6f041249ba5d6aea39f242a)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.131390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcc68c-6cc3-4289-8868-f856987863c7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.147654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 469/929] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:32 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/59f12c409d534a7a8937a1875d421c4d/roles/a2357736f6f041249ba5d6aea39f242a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:33.153081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de62c-59df-4049-ab83-7e449c316afc None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.153270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de62c-59df-4049-ab83-7e449c316afc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.154464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de62c-59df-4049-ab83-7e449c316afc None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.155257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 470/930] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:33.161286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.161645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.161918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.167805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6955e-c19d-48b4-ab37-0f4c01abc548 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.180612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:33.181745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:33.204845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.205519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.205802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.206075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.206793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:33.207100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.208503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.218741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 461/931] 10.222.0.64 () {56 vars in 1114 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:33.219759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.262661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 471/932] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:33.279554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.330844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aacd0d-abe3-4a1c-a6e2-bedff1a7a3ef None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.373150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.374115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.374572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.375017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.376091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.377763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.400529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f6d3-3837-4a26-8dcd-8b4585a102bb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.409662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 462/933] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:33.463339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.465105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.465523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.465987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.466775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.468326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-034d7489-583a-48b3-ab2b-5e8dd404c722 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:33.482701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:33.483868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 06:26:33.484693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.485479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 472/934] 10.222.0.64 () {56 vars in 1132 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:33.495017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.607607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9a322-2bdd-4b95-926c-4c1439cfa518 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.616004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab137-447a-4453-8c23-b7ba22a48c09 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.616509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab137-447a-4453-8c23-b7ba22a48c09 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.616587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab137-447a-4453-8c23-b7ba22a48c09 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.618154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 473/935] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:33.624723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b241a-edc9-4556-8845-6a878f426071 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.624723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b241a-edc9-4556-8845-6a878f426071 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.624723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b241a-edc9-4556-8845-6a878f426071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.643751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.643985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-465b241a-edc9-4556-8845-6a878f426071 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:33.644420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.644704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.644975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.645145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-465b241a-edc9-4556-8845-6a878f426071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:33.645678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:33.646008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.647394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.653172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 463/936] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:33.659567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.726294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 474/937] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:33.748028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b241a-edc9-4556-8845-6a878f426071 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.777924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e9306-134a-46b5-928f-f29ff5d34ac1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.821126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.821949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.822329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.823016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.824280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:33.824587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.826320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.835347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 464/938] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:33.840574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.853186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b241a-edc9-4556-8845-6a878f426071 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:33.887036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:33.888208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:33.888878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:33.889362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:33.890267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:33.891918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:33.905145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:33.906163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:33.907009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:33.914620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 475/939] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:33.915772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:33.961029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ee0c6-3406-4215-a9ef-bb0b8dcf3030 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:34.007886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:34.008645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:34.009036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:34.009319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:34.010058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:34.012136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:34.018447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c59-3ee8-48b9-9453-2e36ba7bde44 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:34.043371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 465/940] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:34.066075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:34.067219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:34.068041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:34.068550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:34.069556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:34.070071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:34.071738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:34.078662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 476/941] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:34.084221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:34.196447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0724a-88f2-49f3-b166-058283596f2e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:34.232772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:34.233438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:34.233717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:34.233987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:34.234682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:34.234982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:34.236359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:34.241360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 466/942] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:34.247704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:34.349745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fd17-ce36-4a4b-a550-d6c681ae65ce None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:34.385269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:34.385995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:34.386768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:34.387039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:34.387861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] RBAC: Adding query filter params (interface=public, service_id=708100096c0f454cb6cdb209e80d6e83, region_id=RegionOne) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:34.388167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:34.389515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e759906-f642-4b92-9274-8a4523d5f814 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:34.394971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 477/943] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:34 2022] GET /identity/v3/endpoints?service_id=708100096c0f454cb6cdb209e80d6e83&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:34.400059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:34.514146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc400-685e-4647-b0e4-af2d982f5dd1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:34.546717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:34.547413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:34.547695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:34.547963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:34.548632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:34.550040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185ee7-6f0b-4077-8cbb-9c0ad75c7181 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:34.556283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 467/944] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:34 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:26:35.509039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ac9c-add1-4a42-acc4-3f8695bc3d0a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.509547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ac9c-add1-4a42-acc4-3f8695bc3d0a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.509650 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ac9c-add1-4a42-acc4-3f8695bc3d0a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.511665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 478/945] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:35.517361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.517789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.517882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.534523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:35.535716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:35.603832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 468/946] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:35.627896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ac9c-add1-4a42-acc4-3f8695bc3d0a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:35.732305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ac9c-add1-4a42-acc4-3f8695bc3d0a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:35.764797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:35.765613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.765892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.766171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.777562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d63b262b-e3a1-4dd1-83f6-bb5536dc8f70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:35.785599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:35.786632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:35.787508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 479/947] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:35.793685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:35.804849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a93b2-4a17-4f4f-9f53-c6e5be6b61a0 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.805115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a93b2-4a17-4f4f-9f53-c6e5be6b61a0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.805387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a93b2-4a17-4f4f-9f53-c6e5be6b61a0 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.807019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 480/948] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:35.812276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.812564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.812841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.829588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:35.830765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:35.897522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 481/949] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:35.897828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10680f-fb9a-4d0d-ac8a-aae9f2a40855 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:35.921109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:35.940359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:35.941466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:35.941748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:35.942298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:35.943332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:35.943800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:35.945752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:35.957050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 469/950] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:35.962062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.021291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1587-bd8b-4147-aa09-2c7755211f8f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.054925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.055715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.056056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.056392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.057198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.058793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.060234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING keystone.server.flask.common [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 06:26:36.061310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b172f4-4866-4918-bfde-9b4e9b377d1e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.078497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.sql.core [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:26:36.078497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 06:26:36.078497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [parameters: {'id': 'dd8288c5135445d8a8457106e279a914', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 06:26:36.078497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79985) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd8288c5135445d8a8457106e279a914.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd8288c5135445d8a8457106e279a914. May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application conn.query(q) May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:26:36.089738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result.read() May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 06:26:36.091875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application next(self.gen) May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application yield resource May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application next(self.gen) May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise self.value May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application session.commit() May 11 06:26:36.093127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.session.flush() May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application compat.raise_( May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:26:36.094304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:26:36.095451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application conn.query(q) May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application result.read() May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:26:36.096404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [parameters: {'id': 'dd8288c5135445d8a8457106e279a914', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.108271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:36.109885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd8288c5135445d8a8457106e279a914. May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 482/951] 10.222.0.64 () {60 vars in 1140 bytes} [Wed May 11 06:26:35 2022] POST /identity/v3/projects => generated 262 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:36.110973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.112182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.112182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.112182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.112182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.115152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.116675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:36.136842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:36.138580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:36.140187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:36.140187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:36.140187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:36.140187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:36.143664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 470/952] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:36.144825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.217168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618ff5b-c0ab-49f2-94ae-ca50079070fd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.249273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45078043-768e-41c4-bc42-4b4590d93dbf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.250312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.251109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.251426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.251696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.258426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.260116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:36.274757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:36.277320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.278877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 483/953] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:36.282160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.286747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.287526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.287776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.288057 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.288774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:36.289825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.290424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.306952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 471/954] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:36.308890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.386825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e8908-b6e2-42c7-b680-d3c2f7f240df None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.412901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f5e0-e094-4333-b9c7-aa6fe29124c0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.422523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.423182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.423491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.423766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.424539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:36.424845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.426268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39c977-4f96-4943-9315-6539eccd1a86 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.454373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 484/955] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:36.454373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ba445-db5a-452b-8bf0-d8e4855520d4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.454373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ba445-db5a-452b-8bf0-d8e4855520d4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.454373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ba445-db5a-452b-8bf0-d8e4855520d4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.454373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 485/956] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:36.457713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.457996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.458275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.462908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.464155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.464655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.464934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.473553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.475211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.476940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:36.478844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:36.491677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:36.492727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 06:26:36.493654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:36.498338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 472/957] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:36.499334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.570548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 486/958] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:36.590251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.615368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca73c3-6536-4ad7-af76-96191d0e18b3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.658898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.659681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.659961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.660279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.661149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:36.661849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.662920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.691255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 473/959] 10.222.0.64 () {56 vars in 1149 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:36.698582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.709711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee023-cdec-4104-9d24-d13e6ed9dc79 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.762230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.763041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.763349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.763622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.764439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.766101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:36.780958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:36.782008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:36.782846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 487/960] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:36.788002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:36.821248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47858d2-7bb5-4c19-b28a-e3199d94aaca None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.861782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.862878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.863287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.863575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.903358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d5ab-8ef1-4077-ab68-81492c1350b7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:36.936789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.938225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4f1c-d394-4329-b42d-15c8d2a5db2c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.941642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:36.942467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.943160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.943661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.944523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:36.944985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:36.946473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0abd78-73c0-4eef-9188-4423f64567a8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:36.955906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 488/961] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:36.957421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354894fc-f990-4530-a553-ca518aac7108 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:36.957876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354894fc-f990-4530-a553-ca518aac7108 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:36.958152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354894fc-f990-4530-a553-ca518aac7108 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:36.959430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 489/962] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:36.960117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354894fc-f990-4530-a553-ca518aac7108 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.040227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 474/963] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:37.041631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.041915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.042727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.059478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:37.060217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354894fc-f990-4530-a553-ca518aac7108 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.060636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:37.095836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.096421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.096695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.096963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.097659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:37.097960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.099329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.115296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 490/964] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:37.115296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.147372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 475/965] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:37.170937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.233475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63051-fc46-4160-a3d1-6dc9b46f8c11 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.281072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.282257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.283362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.283875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.297820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bb5be-cf91-4076-aee4-16c964e14ec3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.300885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.302355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:37.321610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:37.322563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:37.323603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:37.323603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:37.323603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:37.323603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:37.323603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 491/966] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:37.328467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.351182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.352383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.352659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.352925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.353880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.355989 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:37.371522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:37.372725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:37.373574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 476/967] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:37.378833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.454618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877318e3-7a47-450b-925b-f7a45fd5b89d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.488691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.489355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.489631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.489900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.490609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:37.490909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.492663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.504206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 492/968] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:37.506867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4e09e-ad30-4d36-b18e-20dfa4fc31c3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.511312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.545801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.546521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.546802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.547119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.547901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:37.548261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.549725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.554857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 477/969] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:37.560073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.622380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065984ad-6f44-4e82-8bdd-5f96e11f7dcd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.657247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.658407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.658906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.659403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.664909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150fa3-0354-4230-bbda-6eab0468ac7d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.666864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.669074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:37.683721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:37.684612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:37.685637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:37.688236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 493/970] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:37.696615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.702892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.703913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.704359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.704836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.705730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:37.706203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.707792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.713273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 478/971] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:37.720204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.803581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8dd68-ac8b-4f89-a3b4-be6b11276803 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.820902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff9f45-a5fc-4eb3-a8ac-6eb9bd3d9bd2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:37.837971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.839493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.839977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.840422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.841431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:37.841923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.843570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.855772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:37.856430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:37.856709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:37.856982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:37.857789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:37.862665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc8d7f-5b4d-4464-82a2-adcaa72baea8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:37.863109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 494/972] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:37.864358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:37.885068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 479/973] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:37.991070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec68e-464b-4a98-bc3c-3904c5f13f72 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:38.033843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:38.034510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:38.034880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:38.035162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:38.036328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] RBAC: Adding query filter params (role.id=a2357736f6f041249ba5d6aea39f242a, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=59f12c409d534a7a8937a1875d421c4d) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:38.036658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:38.038118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808372-e8fc-4da5-a805-823053c5c561 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:38.045906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 495/974] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:37 2022] GET /identity/v3/role_assignments?user.id=59f12c409d534a7a8937a1875d421c4d&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=a2357736f6f041249ba5d6aea39f242a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:38.851814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08efd4-b0c0-4b73-871d-0f2cc3be7016 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:38.852711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08efd4-b0c0-4b73-871d-0f2cc3be7016 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:38.853178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08efd4-b0c0-4b73-871d-0f2cc3be7016 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:38.854978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 480/975] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:38.860648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:38.861451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:38.861926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:38.879846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:38.881279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:38.949159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 496/976] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:38.974036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08efd4-b0c0-4b73-871d-0f2cc3be7016 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:39.080278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08efd4-b0c0-4b73-871d-0f2cc3be7016 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:39.114318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:39.115256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.115748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.116199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.117107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:39.118703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:39.120788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING keystone.server.flask.common [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 06:26:39.134667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.sql.core [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:26:39.134667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 06:26:39.134667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [parameters: {'user_id': 'cb068f9f61944ee09e7ac82d448999f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 06:26:39.134667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79984) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application conn.query(q) May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result.read() May 11 06:26:39.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:26:39.153849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application next(self.gen) May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application yield resource May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application next(self.gen) May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.session.rollback() May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.force_reraise() May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise self.value May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application session.commit() May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 06:26:39.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._prepare_impl() May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.session.flush() May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._flush(objects) May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application compat.raise_( May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application flush_context.execute() May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rec.execute(self) May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 06:26:39.156268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 06:26:39.157152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result = self._query(query) May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application conn.query(q) May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application result.read() May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 06:26:39.157981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cb068f9f61944ee09e7ac82d448999f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:39.158822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 06:26:39.159794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 06:26:39.160883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:39.163323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 481/977] 10.222.0.64 () {60 vars in 1131 bytes} [Wed May 11 06:26:38 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:39.172837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:39.283278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c64687-a8c2-4f5e-a78c-4eb790b63b15 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:39.322012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:39.322813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.323086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.323424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.330567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:39.332142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-80add1cb-5105-4456-94fe-e6407c12a2ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:39.346844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:39.347821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:39.349385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 497/978] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:39.356575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:39.365885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d8f8-dc66-4e94-b6c7-1282c636c420 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.366113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d8f8-dc66-4e94-b6c7-1282c636c420 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.366529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0d8f8-dc66-4e94-b6c7-1282c636c420 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.369359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 498/979] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:39.373292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.373648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.373996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.390100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:39.391383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:39.470069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f63a8-7d7d-42c8-866d-db4506f84647 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:39.487810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 499/980] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:39.509303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:39.513376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:39.514299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.514806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.515338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.516417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:39.516920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:39.518738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083fc8-37ac-4e8a-8c70-ebfba94304b6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:39.561808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 482/981] 10.222.0.64 () {56 vars in 1101 bytes} [Wed May 11 06:26:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:39.614745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d9d0c-6789-45b6-9f1b-0a57e32bb080 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:39.652807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:39.653491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:39.653772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:39.654044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:39.654792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:39.656231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc51e6-eb2a-47f8-97f9-db3263a105c0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:39.674445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 500/982] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:39 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:40.186223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc5b9-e150-44e7-addd-526f7b58d9f6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.186743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc5b9-e150-44e7-addd-526f7b58d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.186845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc5b9-e150-44e7-addd-526f7b58d9f6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.188462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 483/983] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:40.193900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f80-dbe4-4a39-8576-1b14de582a0b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.194289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f80-dbe4-4a39-8576-1b14de582a0b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.194451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2f80-dbe4-4a39-8576-1b14de582a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.211250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-89cc2f80-dbe4-4a39-8576-1b14de582a0b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:40.212443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-89cc2f80-dbe4-4a39-8576-1b14de582a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:40.280750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 501/984] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:40.302700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acc5b9-e150-44e7-addd-526f7b58d9f6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.329750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3967-1139-44a8-a187-1f71aee67ac7 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.330031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3967-1139-44a8-a187-1f71aee67ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.330298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3967-1139-44a8-a187-1f71aee67ac7 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.331813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 502/985] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:40.336345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.336660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.336933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.352748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:40.353910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:40.405090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acc5b9-e150-44e7-addd-526f7b58d9f6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.423957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 503/986] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:40.442694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.443780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.444063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.444336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.444985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.446345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.446910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:40.459050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:40.460310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:40.461186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 484/987] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:40.468236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.546077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d9764-22cb-477c-98a8-2fcc8f2e721c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.564760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5e08-19ee-4021-8103-74efc52f2c53 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.579547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.580578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.581038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.581458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] PATH_INFO: `/v3/services/image` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.582264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.583815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:40.595412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:40.596388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:40.597213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 504/988] 10.222.0.64 () {56 vars in 1105 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:40.602814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.602937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.603628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.603911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.604182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.605418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:40.605762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.607137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.611936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 485/989] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:40.617433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.707075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ed85-5ea1-4775-941f-3101236c742b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.719371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2b881-12a3-4703-95bc-9c243429b72f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.739684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.740353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.740635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.740912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.741670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] RBAC: Adding query filter params (name=image) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:40.741980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.743363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.748056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 505/990] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:40.753573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.759472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.760137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.760416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.761210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.761914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:40.762216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.763585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.772991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 486/991] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:40.773938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:40.857815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a800e0-81d6-4a90-ad99-dc670d019b85 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.872869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeed3a1-97e3-4924-8444-69d53d9d45cf None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:40.891292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.891960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.892238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.892506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.893204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:40.893506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.894895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.899472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 506/992] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:40.906511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:40.907199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:40.907512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:40.907790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:40.908613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] RBAC: Adding query filter params (interface=admin, service_id=708100096c0f454cb6cdb209e80d6e83, region_id=RegionOne) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:40.908927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:40.910335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae1b6-c7fa-4dcb-a992-733a15f4d410 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:40.916390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 487/993] 10.222.0.64 () {56 vars in 1249 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/endpoints?service_id=708100096c0f454cb6cdb209e80d6e83&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:40.922072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:41.025094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7536ef-a11f-44f8-9e9c-c73778b2c9f1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:41.058873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:41.059576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:41.059857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:41.060127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:41.060808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:41.062193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec794747-f92d-4bcd-a6a5-f1d1c91aaec5 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:41.075291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 507/994] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:40 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:26:41.908404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5acc-d1f6-462e-b145-c09a0ec02043 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:41.908920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5acc-d1f6-462e-b145-c09a0ec02043 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:41.908920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5acc-d1f6-462e-b145-c09a0ec02043 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:41.910299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 488/995] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:41.915636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:41.916014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:41.916180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:41.933242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:41.934400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:41.995854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 508/996] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:42.017985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5acc-d1f6-462e-b145-c09a0ec02043 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:42.115929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5acc-d1f6-462e-b145-c09a0ec02043 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:42.156435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:42.157311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:42.157600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:42.157865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:42.158575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:42.159909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:42.172508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:42.173519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:42.174356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 489/997] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:42.181749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:42.274152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbae9c7-fc5c-4899-b640-7c396b3ddcfa None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:42.306378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:42.307038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:42.307355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:42.308285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:42.308884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:42.309192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:42.310560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:42.319355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 509/998] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:42.321327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:42.419204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881cb2-8420-432c-9e2e-b6b414faa55d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:42.454663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:42.455514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:42.455649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:42.455907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:42.456639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:42.457183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:42.459753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:42.474386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 490/999] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:42.475480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:42.572812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dc643-9311-434f-a875-be1b6f58c2c2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:42.605855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:42.606517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:42.606795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:42.607063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:42.607872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] RBAC: Adding query filter params (interface=public, service_id=7d7005dcc7a74ab68811f875966d612e, region_id=RegionOne) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:42.608196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:42.609542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be788-3c27-4325-92be-954d4b5cfbda None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:42.619053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 510/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:42 2022] GET /identity/v3/endpoints?service_id=7d7005dcc7a74ab68811f875966d612e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:42.620506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:42.716107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13dc38-ac78-47b8-8b59-31b2b041fc71 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:42.747355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:42.748015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:42.748295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:42.748565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:42.749232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:42.750585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85779878-fcb8-4884-8ac3-929bef0a1786 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:42.763304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 491/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:42 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:26:43.149608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc364dc-c5b0-4c93-a142-1179c42b39c7 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.150141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc364dc-c5b0-4c93-a142-1179c42b39c7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.150141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc364dc-c5b0-4c93-a142-1179c42b39c7 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.151698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 511/1002] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:43.157633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f0c5-f43e-4066-a016-68968613b798 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.158135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f0c5-f43e-4066-a016-68968613b798 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.158212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f0c5-f43e-4066-a016-68968613b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.174833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3844f0c5-f43e-4066-a016-68968613b798 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:43.176350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3844f0c5-f43e-4066-a016-68968613b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:43.240291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 492/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:43.263344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc364dc-c5b0-4c93-a142-1179c42b39c7 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:43.326106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145a15-a910-4df0-9a9e-143e74ac4388 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.326394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145a15-a910-4df0-9a9e-143e74ac4388 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.326672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145a15-a910-4df0-9a9e-143e74ac4388 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.328194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 493/1004] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:43.333078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.333370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.333635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.350121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:43.351315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:43.362613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc364dc-c5b0-4c93-a142-1179c42b39c7 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:43.395357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:43.396013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.396289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.396557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.397268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:43.398605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:43.415978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 512/1005] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:43 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:43.439379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 494/1006] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:43 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:43.462602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:43.568826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d5e5b-7b0e-43f7-85c5-e7098594cbe7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:43.604947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:43.605763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.606039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.606307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.606954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:43.608360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:43.621061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:43.622236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 06:26:43.623233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:43.625400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 513/1007] 10.222.0.64 () {56 vars in 1126 bytes} [Wed May 11 06:26:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:43.631588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:43.724601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d480f-b449-46a4-97c8-ef48411f475d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:43.757502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:43.758449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.758871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.759331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.760199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:43.760758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:43.762241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:43.767309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 495/1008] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:43.773026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:43.868223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc45fb-5bf7-4a3f-b817-926ff2f6559b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:43.901128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:43.902293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:43.902570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:43.902841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:43.903574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:43.903881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:43.905236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf015-b5ee-4dc9-8fe8-8e33fd84f250 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:43.910274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 514/1009] 10.222.0.64 () {56 vars in 1122 bytes} [Wed May 11 06:26:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:43.915854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:44.012887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fec3-9d9b-45e7-a8f1-24ea907ccde7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:44.045431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:44.046078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:44.046353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:44.046619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:44.047368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:44.048708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ec3d-9a06-4930-ba7d-270fad004023 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:44.063791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 496/1010] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:45.011079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67306a5-5927-4d4d-a9d1-9558fa8b630e None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.011637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67306a5-5927-4d4d-a9d1-9558fa8b630e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.011637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67306a5-5927-4d4d-a9d1-9558fa8b630e None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.013154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 515/1011] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:45.018085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.018478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.018661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.035245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:45.036431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:45.103748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 497/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:45.125617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67306a5-5927-4d4d-a9d1-9558fa8b630e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:45.223283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67306a5-5927-4d4d-a9d1-9558fa8b630e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:45.261656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:45.262379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.262653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.262919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.263582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:45.264935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:45.277062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:45.278032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:45.278865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 516/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:45.284207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:45.380793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9046-1341-45f3-ad85-d629f8acf8da None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:45.416004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:45.416661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.416966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.417232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.417922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:45.418219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:45.419597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:45.430514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 498/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:45.430760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:45.524604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171642a6-c3d5-490c-99d8-42decf912a1f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:45.555079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:45.555781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.556056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.556324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.557034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:45.557336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:45.559304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff3ef-a80e-488f-896c-60abce1cc694 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:45.569821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 517/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Wed May 11 06:26:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:45.571526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:45.669792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0b9b-9c13-43e8-90f3-5538009250ea None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:45.702357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:45.703010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.703308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.703583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.704319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:45.705658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf1c0-1eb7-4325-9ebe-90361b1e94a9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:45.724716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 499/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:45.761558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6b2d-e1eb-4112-88af-b4106111cc3b None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.761862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6b2d-e1eb-4112-88af-b4106111cc3b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.762166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6b2d-e1eb-4112-88af-b4106111cc3b None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.763715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 518/1017] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:45.769769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:45.770053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:45.770332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:45.787905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:45.789021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:45.866804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 500/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:45.889862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6b2d-e1eb-4112-88af-b4106111cc3b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:45.999433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6b2d-e1eb-4112-88af-b4106111cc3b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.033009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.033802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.034077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.034343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.034984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.036510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:46.048790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:46.049778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:46.050828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 519/1019] 10.222.0.64 () {56 vars in 1105 bytes} [Wed May 11 06:26:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:46.058841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.155940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3e3ee-1e6e-4cf3-b73b-3afc42f47b1a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.190719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.191410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.191690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.191956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.192646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] RBAC: Adding query filter params (name=image) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:46.193210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.194552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596fed-60b0-43df-aa52-6a6b7ba6d99e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.203365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 501/1020] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:46.205376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.309648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2a4f-0878-465c-bee3-b5d981b400b0 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.347347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.348078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.348361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.348681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.348794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fecd-46ac-4a4b-9c38-196fe073983b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.349190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fecd-46ac-4a4b-9c38-196fe073983b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.349394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] RBAC: Adding query filter params (type=image) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:46.349685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5fecd-46ac-4a4b-9c38-196fe073983b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.349780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.352214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.352621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 502/1021] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:46.358246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.358398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 520/1022] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:46.358530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.359396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.364426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.379047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:46.381081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:46.467756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 503/1023] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:46.475439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63455750-7c5d-421a-83dd-40f575ebef57 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.489923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.508204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.508865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.509169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.509414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.510191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] RBAC: Adding query filter params (interface=public, service_id=4a7bac0a4f0049e4a0bb49f374f15e78, region_id=RegionOne) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:46.511009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.512525 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.519062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 521/1024] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:26:46 2022] GET /identity/v3/endpoints?service_id=4a7bac0a4f0049e4a0bb49f374f15e78&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:46.524221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.588651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedf21e-a861-40c7-be33-dcc7365e2d61 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.619646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414afb47-7f14-4214-ae04-7e6f73026071 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.622105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.623173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.623485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.623762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.624933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.626358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.628109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 504/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:46.633596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:46.655048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.655748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.656027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.656299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.656975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.658335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e46d1-30b1-4e3b-a028-64ab4e8adb7d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.675298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 522/1026] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:26:46 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:26:46.746921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d4f2-2a8d-48a1-ba3a-444fcbd2ecad None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:46.782512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:46.783191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:46.783501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:46.783776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:46.784487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:46.785928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aff34-5fe9-4e11-bb80-4427b6e5d6c2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:46.815181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 505/1027] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:26:46 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:48.077372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b63ef-8df2-4b42-a7bf-47a0ede05a43 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.077908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b63ef-8df2-4b42-a7bf-47a0ede05a43 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.077908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b63ef-8df2-4b42-a7bf-47a0ede05a43 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.079463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 523/1028] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:48.084425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.084801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.085021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.101723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:48.102888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:48.165728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 506/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:48.188864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b63ef-8df2-4b42-a7bf-47a0ede05a43 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:48.287586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b63ef-8df2-4b42-a7bf-47a0ede05a43 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:48.319130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:48.319956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.320231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.320500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.330863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:48.338790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:48.339739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:48.340639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:48.342040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 524/1030] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:48.345872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:48.451163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168e6fb-fdfb-4622-88c9-796a63c44852 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:48.484109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:48.484779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.485057 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.485327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.486065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:48.486416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:48.487816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:48.496353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 507/1031] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:48.501739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:48.603620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e9903-f566-42a3-8ea7-3b065f0a8da4 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:48.636249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:48.637037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.637314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.637583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.647089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:48.648555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:48.666010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:48.667735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:48.668658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:48.668658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:48.668658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:48.668658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:48.669432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 525/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:48.673463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:48.771968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37937fd2-135a-448d-bb16-943bd6e2a083 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:48.810890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:48.811583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.811866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.812140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.813484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:48.814038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:48.815766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42b1e-b17c-4a35-bb87-5e963d024369 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:48.838449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 508/1033] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:48.840146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:48.939039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb2daf-6af5-4371-b991-3912aa5e7b3d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:48.952911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9323-c837-4eb7-8151-3e9e55fbb9a5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.953200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9323-c837-4eb7-8151-3e9e55fbb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.953476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9323-c837-4eb7-8151-3e9e55fbb9a5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.954970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 509/1034] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:48.959677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71870f-28be-4bb0-9d33-37488edd8e49 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.959958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71870f-28be-4bb0-9d33-37488edd8e49 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.960233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71870f-28be-4bb0-9d33-37488edd8e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.972819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:48.973622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:48.973905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:48.974177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:48.977597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4e71870f-28be-4bb0-9d33-37488edd8e49 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:48.978773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4e71870f-28be-4bb0-9d33-37488edd8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:48.981734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:48.983169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:48.996997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:48.998117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:48.999181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 526/1035] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:49.004163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.046361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 510/1036] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:49.063061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51890-c7b6-48e6-b1b4-d140301152f7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.063377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51890-c7b6-48e6-b1b4-d140301152f7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.063654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51890-c7b6-48e6-b1b4-d140301152f7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.067576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 511/1037] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:49.069479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51890-c7b6-48e6-b1b4-d140301152f7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.104552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28353a-c5e6-45e6-a74f-49bdb215eb4d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.136924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.138001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.138494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.138988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.140584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:49.141166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.142745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8c2b-85de-42d4-85f8-ce92deda7a20 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.160329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 527/1038] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:49.161582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.161859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.162138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.165876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51890-c7b6-48e6-b1b4-d140301152f7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.177028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:49.178193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:49.199000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.199751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.200023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.200286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] PATH_INFO: `/v3/services/image` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.200923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.202253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:49.213312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:49.214424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:49.215258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 512/1039] 10.222.0.64 () {56 vars in 1105 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:49.216759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.241456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 528/1040] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:49.242320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.316609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6e2e-e073-4094-b3f6-a4e49245d613 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.336332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254dd76-0a7b-45c4-bb06-45706fa12d2b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.348826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.349497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.349783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.350058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.367214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.367895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.368169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.368438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.369133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] RBAC: Adding query filter params (name=image) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:49.369432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.371333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.376008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 529/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:49.376761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.415868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.417805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.472440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a079-34ff-4163-acce-3e8df34e2d55 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.503790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.504569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.504844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.505107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.506301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.507700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.509299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 530/1042] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:49.510089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.516869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 513/1043] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:49.516869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.605345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafa7c-cc55-4d01-aeb9-c97fe02132b8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.605791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86dca-d45b-4322-81d1-db10712f44fc None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.636612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.636764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.637258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.637415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.637547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.637692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.637782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.637959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.638465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] RBAC: Adding query filter params (type=image) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:49.638643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.638766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.640136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.640232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.644718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 531/1044] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:49.645465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.671295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 514/1045] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:26:49 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:26:49.671295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.747819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e9e9-8241-4ae8-a4cc-93623a1d2d73 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.766690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdd4f1-83ed-4dd0-8469-80c06644f2e2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.782156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.782959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.783238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.783549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.797895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.799413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.802598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.803604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.804071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.804578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.805584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.807229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:49.817683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:49.824057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:49.825014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:49.825014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:49.825014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:49.825014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:49.825014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 532/1046] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:49.825306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:49.829727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 515/1047] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:26:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:26:49.937997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e270de-8cfc-400f-980b-1781a8325e64 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:49.980374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:49.981042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:49.981313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:49.981601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:49.982323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:49.982624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:49.984034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:49.996817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 533/1048] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:50.002878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:50.102074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1521f-354c-4fda-b327-1e89c67f3dd7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:50.134148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:50.134941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:50.135221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:50.135520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:50.142016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:50.143459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:50.157845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:50.158791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:50.159762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 516/1049] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:50.166005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:50.260131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4cff9-ee84-4de3-8bf9-5c5253311ee1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:50.292991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:50.293674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:50.293953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:50.294224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:50.294996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:50.295323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:50.296738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc8e6b-8518-4306-8a26-3455f96d207b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:50.312839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 534/1050] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:50.314059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:50.411030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958876b-bde0-455e-8000-0f0460873258 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:50.444109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:50.445846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:50.445846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:50.445846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:50.445846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] RBAC: Adding query filter params (role.id=a2357736f6f041249ba5d6aea39f242a, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:50.445846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:50.447811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e04a6-9c33-4c0b-b310-6c57fbf2005c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:50.459496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 517/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:50 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=a2357736f6f041249ba5d6aea39f242a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:51.974659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef952d5-b0af-4631-8119-d2010272c153 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:51.975222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef952d5-b0af-4631-8119-d2010272c153 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:51.975222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef952d5-b0af-4631-8119-d2010272c153 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:51.979322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 535/1052] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:51.981924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5858-aa19-4019-98f7-66512ff49a8f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:51.982319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5858-aa19-4019-98f7-66512ff49a8f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:51.982497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5858-aa19-4019-98f7-66512ff49a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:51.998716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3b7c5858-aa19-4019-98f7-66512ff49a8f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:51.999911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3b7c5858-aa19-4019-98f7-66512ff49a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:52.064661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 518/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:52.064985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762f83c-1fe6-413c-9bd7-0fb8ca6e25ab None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.065269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762f83c-1fe6-413c-9bd7-0fb8ca6e25ab None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.065542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762f83c-1fe6-413c-9bd7-0fb8ca6e25ab None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.066997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 536/1054] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:52.072253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.072543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.072844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.088643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762f83c-1fe6-413c-9bd7-0fb8ca6e25ab None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.090583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:52.091809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:52.156517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 519/1055] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:52.178627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.189150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762f83c-1fe6-413c-9bd7-0fb8ca6e25ab None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.222791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.223608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.223891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.224192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.234614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:52.242121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:52.243106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:52.243996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 537/1056] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:52.249744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.276508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc63f3-26f1-4011-a34b-d7baad669ed3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.308884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.309523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.309797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.310066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.349194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848788-86d6-4c96-ab91-0e6e46799ac2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.375509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.376938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.382035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.382698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.382975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.383246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.384003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:52.384306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.386207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.395148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 538/1057] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:52.400292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.487729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 520/1058] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 06:26:52.493362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.515565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a353d-c1fd-48e8-8652-5a2be912ccb7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.553982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15764017-325a-4694-ba37-b26105757b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.554872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15764017-325a-4694-ba37-b26105757b0a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.555152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15764017-325a-4694-ba37-b26105757b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.555458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15764017-325a-4694-ba37-b26105757b0a None admin] PATH_INFO: `/v3/users/f75f3360a9ba4f0aa098066a795c28d6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.570031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15764017-325a-4694-ba37-b26105757b0a None admin] RBAC: Authorizing `identity:get_user(user_id=f75f3360a9ba4f0aa098066a795c28d6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.571496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15764017-325a-4694-ba37-b26105757b0a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.573697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 539/1059] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/users/f75f3360a9ba4f0aa098066a795c28d6 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:52.579166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15764017-325a-4694-ba37-b26105757b0a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.602168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad1f8-d760-4aea-b856-86d3b20a1e42 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.635040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.636393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.636673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.636945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.646603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.648044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-553676c0-540d-4503-b015-098c3e349a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:52.665133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:52.666002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:52.666933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:52.666933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:52.666933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:52.666933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:52.666933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 521/1060] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:52.667864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6010-83e2-4e8c-bad8-b0eaec5e0519 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.668142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6010-83e2-4e8c-bad8-b0eaec5e0519 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.668409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6010-83e2-4e8c-bad8-b0eaec5e0519 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.669664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 522/1061] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:52.672172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6010-83e2-4e8c-bad8-b0eaec5e0519 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.677398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15764017-325a-4694-ba37-b26105757b0a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.709436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.710070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.710346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.710618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.767935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6010-83e2-4e8c-bad8-b0eaec5e0519 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:52.773104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.774547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.799776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:52.800417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.800692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.800956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.801650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:52.801945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:52.803292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c591-6ff6-4f8c-ae9e-91bbcef50e33 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:52.814261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 523/1062] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:52.815622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:52.815903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:52.816174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:52.837502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:52.838725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:52.876480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 540/1063] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 06:26:52.882639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.915980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 524/1064] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:52.940137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:52.987588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b03fe-54b1-4164-8c46-63bd95555201 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.023537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.024492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.024843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.025118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.026382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.027887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.030350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 541/1065] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:53.036018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.050594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764aa3-3a0f-40a9-a91c-93c3096345c3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.089980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.090805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.091086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.091385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.103645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:53.112025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:53.112971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:53.113809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 525/1066] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:53.119196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.139342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ea28-ece7-4d37-8f81-361c315715c3 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.171097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.171764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.172042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.172310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.173129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=a04cc67211cf427c865df8dc711fa6c1, user.id=f75f3360a9ba4f0aa098066a795c28d6) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:53.173433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.174846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.180088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 542/1067] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/role_assignments?user.id=f75f3360a9ba4f0aa098066a795c28d6&scope.project.id=a04cc67211cf427c865df8dc711fa6c1&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:53.217576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5154-05b1-47d9-980e-a1496bf9f1d9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.252907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.253581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.253863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.254138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.254905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:53.255212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.256635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.265514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 526/1068] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:53.271393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.379602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d092-283c-43d6-a721-c871089cc84f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.411550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.412339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.412622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.412894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.422982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.424452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:53.449804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:53.450883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:53.452002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:53.452002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:53.452002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:53.452002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:53.455607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 543/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:53.456650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.551844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04a4d-0f8f-4dad-a40a-e11dfe9367bc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.584146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.584794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.585072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.585340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.586043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:53.586342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.587708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.599347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 527/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:53.605461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.698554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a744cf4-81e6-41ea-a840-fa012c424e20 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.730956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.731769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.732045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.732311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.738953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.740428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:53.754166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:53.755243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:53.756407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:53.759425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 544/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:53.760990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:53.854934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da632c6-b403-4ab2-8de5-a3e7a57a8e68 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:53.886407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:53.887071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:53.887377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:53.887651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:53.888472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:53.888776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:53.890190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:53.907178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 528/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:53.912668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:54.005500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71bf3-d0ca-4b1e-bcf7-3cc9ccb6c70e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:54.037862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:54.038643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:54.038921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:54.039192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:54.048664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:54.050103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:54.066624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:54.067654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:54.068811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:54.068811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:54.068811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:54.068811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:54.068811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 545/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:54.074229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:54.166697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba13f0-86e2-469d-9a75-aad676f70e65 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:54.199432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:54.200077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:54.200352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:54.200620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:54.201316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:54.201612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:54.202941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:54.213371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 529/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:54.219491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:54.312471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea49ea-dcaf-4b20-9092-0eae71eccdae None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:54.344203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:54.344980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:54.345254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:54.345519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:54.351913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:54.353335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:54.366444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:54.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:54.368624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 546/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:54.373943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:54.470926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a801-1da2-4a84-828b-7682326f6fb8 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:54.502431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:54.503079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:54.503373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:54.503642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:54.504408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:54.504710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:54.506115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5345b-970b-4f8b-a98a-f71f90e5e2c5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:54.518039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 530/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:54.523972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:54.617466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb60e-5750-4a87-ae98-0bf32cbb3b58 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:54.649005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:54.649875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:54.650154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:54.650425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/a2357736f6f041249ba5d6aea39f242a` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:54.652637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=d8526efe49fd469bb829106580483ea0, role_id=a2357736f6f041249ba5d6aea39f242a)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:54.654070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2d8d1-a465-446c-9d79-16d95d64a28c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:54.666339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 547/1077] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:54 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/d8526efe49fd469bb829106580483ea0/roles/a2357736f6f041249ba5d6aea39f242a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:55.382808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af88f-46f6-4558-8d22-4d6054285f04 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:55.383358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af88f-46f6-4558-8d22-4d6054285f04 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:55.383358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af88f-46f6-4558-8d22-4d6054285f04 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:55.384723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 531/1078] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:55.391893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:55.392383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:55.392476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:55.409291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:55.410457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:55.475762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 548/1079] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:55.498810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af88f-46f6-4558-8d22-4d6054285f04 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:55.593592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af88f-46f6-4558-8d22-4d6054285f04 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:55.626116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:55.626896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:55.627173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:55.627481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:55.637050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:55.644662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:55.645607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:55.646447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 532/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:55.651768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:55.742348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd6769-1909-42fe-9694-4fdb73e486ba None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:55.775603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:55.776307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:55.776582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:55.776850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:55.777586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:55.777886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:55.779243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:55.787069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 549/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:55.793410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:55.886543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1667-88e8-411c-83b8-4d937d753c72 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:55.918344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:55.919134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:55.919443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:55.919712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] PATH_INFO: `/v3/users/f75f3360a9ba4f0aa098066a795c28d6` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:55.920863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f3360a9ba4f0aa098066a795c28d6)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:55.922261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:55.924052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 533/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:26:55 2022] GET /identity/v3/users/f75f3360a9ba4f0aa098066a795c28d6 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:55.929574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:56.021573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513984ab-e67c-40b6-b7b6-1b1e9fe2ddca None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:56.053230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:56.054083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:56.054361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:56.054631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:56.055807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:56.057246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655a475-7bda-4699-a722-b29dc884a13d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:56.058910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 550/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:26:55 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:56.064826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:56.156820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2445ba-8d3d-4973-8e1d-72fe5646ccb1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:56.187977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:56.188783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:56.189058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:56.189330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1/users/f75f3360a9ba4f0aa098066a795c28d6/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:56.191218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] RBAC: Authorizing `identity:create_grant(project_id=a04cc67211cf427c865df8dc711fa6c1, user_id=f75f3360a9ba4f0aa098066a795c28d6, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:56.192666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72f611-dca0-4fa6-a01b-98f3cf021385 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:56.205623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 534/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:26:56 2022] PUT /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1/users/f75f3360a9ba4f0aa098066a795c28d6/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:26:56.866742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887964d-8b7c-476c-9d46-012eb6925430 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:56.867312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887964d-8b7c-476c-9d46-012eb6925430 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:56.867312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887964d-8b7c-476c-9d46-012eb6925430 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:56.868674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 551/1085] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:26:56.874503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:56.874926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:56.875063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:56.891878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:56.893048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:56.957297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 535/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:26:56.981449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887964d-8b7c-476c-9d46-012eb6925430 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.077039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887964d-8b7c-476c-9d46-012eb6925430 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.107927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.108733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.109015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.109287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.119244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:57.127952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:57.129021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:57.129876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 552/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Wed May 11 06:26:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:57.135155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.226569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7aba-82c7-4283-b63f-c4bbbd075101 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.258894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.259585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.259867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.260141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.260899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:57.261201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:57.262548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:57.270126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 536/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:57.275742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.370957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab8a97-dc5a-4ae8-a12c-52cc68e9f410 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.405895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.406698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.406976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.407250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.417672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:57.419146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:57.436981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:57.437981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:57.438944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:57.438944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:57.438944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:57.438944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:57.438944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 553/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:57.444216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.542042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a36ef-d534-4b34-a7e2-bbfd0a2bb0d0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.574506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.575158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.575472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.575752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.576460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:57.576764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:57.578116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:57.589173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 537/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:57.594803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.686454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b745-8f94-4f61-8298-6008c9945975 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.719098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.719909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.720180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.720441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.727126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:57.728587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:26:57.742728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:57.743879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:57.745570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 554/1091] 10.222.0.64 () {56 vars in 1093 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:26:57.750105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.843942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439be8-c1ee-4c15-b3b0-23bf30c18f6b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:57.877131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:57.877810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:57.878075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:57.878342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:57.879159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:57.879493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:57.880896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:57.897136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 538/1092] 10.222.0.64 () {56 vars in 1133 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:57.902711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:57.997249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac38f0-f7c7-4e55-92c1-eb09ff09508c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.028063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.028701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.028976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.029243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.091918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.093337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.183013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 555/1093] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:26:58.188666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.291223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aa783-7432-4377-8f71-afbf89d0737d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.323365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.324144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.324420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.324688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.334142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.335622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2f64b6a4-d5c1-4c33-90c3-7d6a65d9a6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:26:58.352849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:58.353710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:58.355241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:26:58.355241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:26:58.355241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:26:58.355241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:58.355241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 539/1094] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:58.360159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.400478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348768-1878-4a19-92b1-10e74bfe0968 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.400763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348768-1878-4a19-92b1-10e74bfe0968 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.401555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348768-1878-4a19-92b1-10e74bfe0968 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.403050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 540/1095] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:26:58.408208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.408489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.408761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.426249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:26:58.427447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:26:58.453504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117593-ab2b-4f1d-833f-c8ec4306db61 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.485182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.485827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.486128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.486401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.487106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:58.487442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.488782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.491131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 541/1096] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:26:58.499436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 556/1097] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:58.504777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.514492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.600438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94555e7c-4217-4dc9-be87-0ccc9fbccd5d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.607118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820f8a-8b6d-43be-a9df-c5cfd6db1df6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.632052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.632830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.633102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.633369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.639165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.639975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.640254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.640344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.640528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.641767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.650028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:26:58.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:58.656571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:26:58.657483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 542/1098] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:26:58.658357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:26:58.659430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:26:58.660693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 557/1099] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:26:58.662716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.665098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.754176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea78b4-96ac-4bc0-9d1e-bde323b6b781 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.757166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7a246-3141-4c19-8119-dccf02f2539a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.786432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702024-0d27-438a-8938-034182735772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.787075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702024-0d27-438a-8938-034182735772 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.787376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702024-0d27-438a-8938-034182735772 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.787647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702024-0d27-438a-8938-034182735772 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.788418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702024-0d27-438a-8938-034182735772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:58.788714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702024-0d27-438a-8938-034182735772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.789682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.790113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702024-0d27-438a-8938-034182735772 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.790344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.790619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.790884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.791675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:58.791974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.793307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.801128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 558/1100] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:58.801449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 543/1101] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:58.807553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.807698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702024-0d27-438a-8938-034182735772 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.898817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b957-b5e7-4585-a298-e4fd1ec742ae None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.899535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702024-0d27-438a-8938-034182735772 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:58.929119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.929978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.930253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.930519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] PATH_INFO: `/v3/users/f75f3360a9ba4f0aa098066a795c28d6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.930782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:58.931449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:58.931715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f3360a9ba4f0aa098066a795c28d6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.931805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:58.931985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:58.933308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] RBAC: Adding query filter params (role.id=a2357736f6f041249ba5d6aea39f242a, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=d8526efe49fd469bb829106580483ea0) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:58.933616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:58.933723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.935010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:58.935231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 559/1102] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/users/f75f3360a9ba4f0aa098066a795c28d6 => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:58.940741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:58.941091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 544/1103] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/role_assignments?user.id=d8526efe49fd469bb829106580483ea0&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=a2357736f6f041249ba5d6aea39f242a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:26:59.040121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258a779-c10f-4317-91f9-30d6005a9d48 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:59.074005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:59.074664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:59.074940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:59.075210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:59.140775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:59.142202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:59.235998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 560/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 06:26:59.242050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:59.340410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098318-668c-46ea-ba2e-47f9a2a7367d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:59.373814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:59.374678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:59.374962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:59.375240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:59.376455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:59.377870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b98763-b6e9-478f-a54f-8b606ee55689 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:59.379643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 545/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:26:59 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:26:59.386003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:26:59.488441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7ebd4-c4f4-4946-9a72-73a1870c5d08 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:26:59.522132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:26:59.522789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:26:59.523064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:26:59.523367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:26:59.524188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=a04cc67211cf427c865df8dc711fa6c1, user.id=f75f3360a9ba4f0aa098066a795c28d6) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:26:59.524495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:26:59.526191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770b36-01f9-4656-a193-7e3df0b566fc None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:26:59.532239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 561/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:26:59 2022] GET /identity/v3/role_assignments?user.id=f75f3360a9ba4f0aa098066a795c28d6&scope.project.id=a04cc67211cf427c865df8dc711fa6c1&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:01.759069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb11f6-8090-44b7-8cfa-0d2826da7cdc None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:01.759646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb11f6-8090-44b7-8cfa-0d2826da7cdc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:01.759646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb11f6-8090-44b7-8cfa-0d2826da7cdc None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:01.761436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 546/1107] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:01.766595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:01.767024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:01.767149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:01.784011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:01.785181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:01.853998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 562/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:01.879074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb11f6-8090-44b7-8cfa-0d2826da7cdc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:01.975847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb11f6-8090-44b7-8cfa-0d2826da7cdc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:02.007821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:02.008593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:02.008868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:02.009184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:02.010879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:02.012309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99411-9d91-43e0-be5c-549871a4e24f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:02.013877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 547/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:02.019545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:02.110503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ab004-a7be-4288-bb7b-e1004c767f97 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:02.142248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:02.142910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:02.143189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:02.143489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:02.144193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:02.145611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaa60-2c19-4d7e-9118-8b1fd07a53cf None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:02.164879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 563/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:27:02 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:04.398925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f615d-cf09-4acd-aa63-a8f133c7fa36 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:04.399475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f615d-cf09-4acd-aa63-a8f133c7fa36 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:04.399475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f615d-cf09-4acd-aa63-a8f133c7fa36 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:04.401383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 548/1111] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:04.406560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:04.406966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:04.407103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:04.423761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:04.424909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:04.485998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 564/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:04.509155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f615d-cf09-4acd-aa63-a8f133c7fa36 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:04.608394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f615d-cf09-4acd-aa63-a8f133c7fa36 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:04.639694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:04.640530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:04.640807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:04.641079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] PATH_INFO: `/v3/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:04.642519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] RBAC: Authorizing `identity:get_role(role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:04.643909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:04.645268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 549/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:04 2022] GET /identity/v3/roles/0b454d4febc34038bd35eda57f52340d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:04.651781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:04.741874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c1d2e-cfa2-4073-9af2-a56e67f87dbf None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:04.772760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:04.773600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:04.773875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:04.774141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] PATH_INFO: `/v3/users/4d08704ee4f04da8b51374bd44b417fc` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:04.786641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] RBAC: Authorizing `identity:get_user(user_id=4d08704ee4f04da8b51374bd44b417fc)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:04.788088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:04.789674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 565/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:04 2022] GET /identity/v3/users/4d08704ee4f04da8b51374bd44b417fc => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:04.795341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:04.888834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584605-18c4-463a-920e-aa950ebde4d9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:04.919854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:04.920426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:04.920707 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:04.920981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:04.983121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:04.984561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:05.080718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 550/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:05.086523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:05.177306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680dec8-25e4-4646-a2e0-7ba080857164 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:05.208439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:05.209265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:05.209535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:05.209798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:05.210935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:05.212368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d695b-bc3c-40b1-887b-5e1a46f4775e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:05.214037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 566/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:05 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:05.219829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:05.312321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8380e-0143-4821-9294-bf8e4a9e5a01 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:05.343712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:05.344345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:05.344627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:05.344901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:05.345713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=a04cc67211cf427c865df8dc711fa6c1, user.id=4d08704ee4f04da8b51374bd44b417fc) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:05.346023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:05.347453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada94b1-2498-48e3-81a5-1e48662a6460 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:05.352594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 551/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:05 2022] GET /identity/v3/role_assignments?user.id=4d08704ee4f04da8b51374bd44b417fc&scope.project.id=a04cc67211cf427c865df8dc711fa6c1&role.id=0b454d4febc34038bd35eda57f52340d => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:07.523878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1198c-bba7-479a-a7e2-d4cb152453a0 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:07.524404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1198c-bba7-479a-a7e2-d4cb152453a0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:07.524404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1198c-bba7-479a-a7e2-d4cb152453a0 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:07.525802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 567/1118] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:07.531071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:07.531635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:07.531635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:07.549752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:07.550981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:07.614126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 552/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:07.636869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1198c-bba7-479a-a7e2-d4cb152453a0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:07.729869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1198c-bba7-479a-a7e2-d4cb152453a0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:07.760701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:07.761524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:07.761798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:07.762064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] PATH_INFO: `/v3/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:07.763515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] RBAC: Authorizing `identity:get_role(role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:07.764871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:07.766199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 568/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:07 2022] GET /identity/v3/roles/0b454d4febc34038bd35eda57f52340d => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:07.771686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:07.863411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c937973-b131-49d3-8830-13d37b1fe722 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:07.902835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:07.903721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:07.903998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:07.904266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] PATH_INFO: `/v3/users/4d08704ee4f04da8b51374bd44b417fc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:07.905427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] RBAC: Authorizing `identity:get_user(user_id=4d08704ee4f04da8b51374bd44b417fc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:07.906841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:07.908483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 553/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:07 2022] GET /identity/v3/users/4d08704ee4f04da8b51374bd44b417fc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:07.914198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:08.005408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc95f-e410-47c9-b447-b29c6f97e1da None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:08.036843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:08.037669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:08.037943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:08.038210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:08.039379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:08.040781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7c71c-3de2-4d6d-bc04-8b82a924ec14 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:08.043018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 569/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:07 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:08.048720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:08.139751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a52c6-507c-427b-a5f8-9a2cbcb74112 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:08.171797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:08.172643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:08.172919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:08.173186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1/users/4d08704ee4f04da8b51374bd44b417fc/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:08.175384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] RBAC: Authorizing `identity:create_grant(project_id=a04cc67211cf427c865df8dc711fa6c1, user_id=4d08704ee4f04da8b51374bd44b417fc, role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:08.176790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceff06-5bc1-450d-8a19-714667f1fe2f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:08.189297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 554/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:27:08 2022] PUT /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1/users/4d08704ee4f04da8b51374bd44b417fc/roles/0b454d4febc34038bd35eda57f52340d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:27:10.351686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5acd7-0ac2-4dcb-911e-deafbb218a0c None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:10.352218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5acd7-0ac2-4dcb-911e-deafbb218a0c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:10.352218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5acd7-0ac2-4dcb-911e-deafbb218a0c None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:10.353583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 570/1124] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:10.359469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:10.359866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:10.360019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:10.376079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:10.377248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:10.439877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 555/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:10.463948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5acd7-0ac2-4dcb-911e-deafbb218a0c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:10.557195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5acd7-0ac2-4dcb-911e-deafbb218a0c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:10.589017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:10.589848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:10.590127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:10.590398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] PATH_INFO: `/v3/roles/0b454d4febc34038bd35eda57f52340d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:10.591862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] RBAC: Authorizing `identity:get_role(role_id=0b454d4febc34038bd35eda57f52340d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:10.593216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:10.594555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 571/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:10 2022] GET /identity/v3/roles/0b454d4febc34038bd35eda57f52340d => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:10.600244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:10.691085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087f3b0-0702-4598-a9c8-f6197479eb8a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:10.723765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:10.724627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:10.724905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:10.725177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] PATH_INFO: `/v3/users/4d08704ee4f04da8b51374bd44b417fc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:10.726351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] RBAC: Authorizing `identity:get_user(user_id=4d08704ee4f04da8b51374bd44b417fc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:10.727793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:10.729438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 556/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:10 2022] GET /identity/v3/users/4d08704ee4f04da8b51374bd44b417fc => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:10.735170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:10.827512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa599da-b6bb-4f2d-9d8e-2e58d4959308 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:10.857769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:10.858386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:10.858743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:10.859011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:10.920969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:10.922382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:11.013271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 572/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:11.018837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:11.110837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228af38-06a7-4569-93a8-a73c16d43d6e None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:11.142968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:11.143845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:11.144127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:11.144406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] PATH_INFO: `/v3/projects/a04cc67211cf427c865df8dc711fa6c1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:11.145558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a04cc67211cf427c865df8dc711fa6c1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:11.146970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615276a-013e-4d44-9441-60fd0096c5d3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:11.148644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 557/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:11 2022] GET /identity/v3/projects/a04cc67211cf427c865df8dc711fa6c1 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:11.154578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:11.246279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782cb2-6c3a-469a-821e-699d97db9e93 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:11.277166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:11.277744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:11.278019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:11.278289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:11.279099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] RBAC: Adding query filter params (role.id=0b454d4febc34038bd35eda57f52340d, scope.project.id=a04cc67211cf427c865df8dc711fa6c1, user.id=4d08704ee4f04da8b51374bd44b417fc) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:11.279436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:11.280847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35927-acbf-46fe-89eb-9e6874d49452 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:11.286316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 573/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:11 2022] GET /identity/v3/role_assignments?user.id=4d08704ee4f04da8b51374bd44b417fc&scope.project.id=a04cc67211cf427c865df8dc711fa6c1&role.id=0b454d4febc34038bd35eda57f52340d => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:13.486796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cece-61a4-498a-901a-0c9dee578cab None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:13.487259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cece-61a4-498a-901a-0c9dee578cab None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:13.487376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cece-61a4-498a-901a-0c9dee578cab None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:13.488731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 558/1131] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:13.493983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:13.494368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:13.494533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:13.511468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:13.512737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:13.577916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 574/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:13.606026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cece-61a4-498a-901a-0c9dee578cab None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:13.702464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cece-61a4-498a-901a-0c9dee578cab None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:13.733496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:13.734261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:13.734536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:13.734805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:13.735925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:13.737334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72545e-3074-484c-b620-49645a7ba605 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:13.738914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 559/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:13.744680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:13.836474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ada5-ae57-462c-b02c-c7a69acd85f0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:13.867024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:13.867680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:13.867956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:13.868221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:13.868902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:13.870809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8cd9-05d0-4cca-b3dc-e46c1ba8373b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:13.895279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 575/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:27:13 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:16.122648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862193-0ff3-4033-91ca-b8f8591418d4 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:16.123209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862193-0ff3-4033-91ca-b8f8591418d4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:16.123209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862193-0ff3-4033-91ca-b8f8591418d4 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:16.124565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 560/1135] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:16.129818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553ff5-3386-4b99-9445-19150a964fda None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:16.130232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553ff5-3386-4b99-9445-19150a964fda None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:16.130373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553ff5-3386-4b99-9445-19150a964fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:16.146601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-45553ff5-3386-4b99-9445-19150a964fda None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:16.147790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-45553ff5-3386-4b99-9445-19150a964fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:16.209204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 576/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:27:16.233447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862193-0ff3-4033-91ca-b8f8591418d4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:16.326982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862193-0ff3-4033-91ca-b8f8591418d4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:16.358501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:16.359258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:16.359562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:16.359829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:16.360955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:16.362389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575621e-2a00-43f2-96fd-59e134a3b99a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:16.363967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 561/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:27:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:16.369430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45553ff5-3386-4b99-9445-19150a964fda None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:16.459677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45553ff5-3386-4b99-9445-19150a964fda None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:16.490812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:16.491491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:16.491768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:16.492033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:16.492724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:16.494158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17391-5a7f-47ac-9694-5d5ed636ffd8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:16.514506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 577/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:27:16 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:18.763230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617acf8-a6d2-4e37-9506-e5f573724ada None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:18.763768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617acf8-a6d2-4e37-9506-e5f573724ada None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:18.763768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617acf8-a6d2-4e37-9506-e5f573724ada None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:18.765197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 562/1139] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:18.770461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:18.770898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:18.771009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:18.787960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:18.789130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:18.852705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 578/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:18.876952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617acf8-a6d2-4e37-9506-e5f573724ada None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:18.975246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617acf8-a6d2-4e37-9506-e5f573724ada None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.007857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.008639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.008919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.009187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.019214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:19.026820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:19.028010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:19.028940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 563/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:19.034122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:19.131517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cbefc-4c46-4dfb-9c5d-108e77660b56 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.170039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.170809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.171128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.171483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.172293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:19.172639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:19.174040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:19.182089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 579/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:19.187893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:19.284976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94dcf7-216b-4dae-9c31-ad41f9dbaa1b None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.317070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.318189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.318466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.318738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] PATH_INFO: `/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.331110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] RBAC: Authorizing `identity:get_user(user_id=5a5d09330b7143ca9a2d3a5d43d3fe8e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:19.332565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:19.334190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 564/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:19 2022] GET /identity/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:19.340527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:19.432699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72d8f-2e35-4a99-9167-a78c0f642128 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.464290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.464924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.465200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.465470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.527499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:19.528920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:19.627439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 580/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:19.633543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:19.728806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a711786-d615-4224-941d-1cb095fc2f55 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.760017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.760909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.761187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.761458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] PATH_INFO: `/v3/projects/98aeb75dbd3b4e90930756f6f508253d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.762632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] RBAC: Authorizing `identity:get_project(project_id=98aeb75dbd3b4e90930756f6f508253d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:19.764063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7c73-c8c6-46be-aff5-3609409650a6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:19.765736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 565/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:19 2022] GET /identity/v3/projects/98aeb75dbd3b4e90930756f6f508253d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:19.771875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:19.863610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41581-b39f-4701-944d-d1cdd2f21ac8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:19.898735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:19.899338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:19.899613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:19.899883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:19.901248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=98aeb75dbd3b4e90930756f6f508253d, user.id=5a5d09330b7143ca9a2d3a5d43d3fe8e) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:19.901554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:19.902978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f3be-6ae0-4ad6-8f00-ad5472d289a6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:19.908263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 581/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:19 2022] GET /identity/v3/role_assignments?user.id=5a5d09330b7143ca9a2d3a5d43d3fe8e&scope.project.id=98aeb75dbd3b4e90930756f6f508253d&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:22.083817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea88-64c3-4faf-a0af-2cf3cb3a2b30 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.084401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea88-64c3-4faf-a0af-2cf3cb3a2b30 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.084401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea88-64c3-4faf-a0af-2cf3cb3a2b30 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.085726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 566/1147] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:22.090905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.091284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.091481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.107438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:22.108588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:22.168779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 582/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:22.190722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddea88-64c3-4faf-a0af-2cf3cb3a2b30 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:22.286492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddea88-64c3-4faf-a0af-2cf3cb3a2b30 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:22.318274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:22.319049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.319358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.319629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.329694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:22.337293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:22.338356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:22.339535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 567/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:22.344332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:22.436141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de5be-1380-4a11-9640-63d8ca5a0862 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:22.467026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:22.467697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.467974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.468241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.468962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:22.469260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:22.470601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:22.479088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 583/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:22.484814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:22.578022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a605d1-843f-45a6-a3df-4aa554a75111 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:22.608854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:22.609632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.609905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.610171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] PATH_INFO: `/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.611340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] RBAC: Authorizing `identity:get_user(user_id=5a5d09330b7143ca9a2d3a5d43d3fe8e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:22.612754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:22.614335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 568/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:22 2022] GET /identity/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:22.620376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:22.712070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df870-f524-4677-955f-c1ad7f6bcb7a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:22.742919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:22.743786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.744617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.744889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] PATH_INFO: `/v3/projects/98aeb75dbd3b4e90930756f6f508253d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.746043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] RBAC: Authorizing `identity:get_project(project_id=98aeb75dbd3b4e90930756f6f508253d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:22.747475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059070f4-7f9c-4dc3-8fd6-3f4202176405 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:22.749131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 584/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:22 2022] GET /identity/v3/projects/98aeb75dbd3b4e90930756f6f508253d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:22.754667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:22.847327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70a96-3697-4d5b-a92f-81ca865d207c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:22.878149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:22.879016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:22.879315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:22.879589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] PATH_INFO: `/v3/projects/98aeb75dbd3b4e90930756f6f508253d/users/5a5d09330b7143ca9a2d3a5d43d3fe8e/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:22.881478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] RBAC: Authorizing `identity:create_grant(project_id=98aeb75dbd3b4e90930756f6f508253d, user_id=5a5d09330b7143ca9a2d3a5d43d3fe8e, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:22.882880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523fa5-eb23-4c0c-9fcf-e39bdf40375d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:22.895487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 569/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:27:22 2022] PUT /identity/v3/projects/98aeb75dbd3b4e90930756f6f508253d/users/5a5d09330b7143ca9a2d3a5d43d3fe8e/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:27:25.047799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625fb5-6ffc-405e-8a89-6ec4fc3f27f7 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.048357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625fb5-6ffc-405e-8a89-6ec4fc3f27f7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.048357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625fb5-6ffc-405e-8a89-6ec4fc3f27f7 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.049699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 585/1154] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:25.054757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.055150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.055336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.072627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:25.073786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:25.136656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 570/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:25.159076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625fb5-6ffc-405e-8a89-6ec4fc3f27f7 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:25.254069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625fb5-6ffc-405e-8a89-6ec4fc3f27f7 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:25.284721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:25.285488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.285766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.286035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.295876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:25.303388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:25.304469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:27:25.305445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 586/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:25.310728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:25.402764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e2c7a-c8aa-4105-abfe-f5e27e6ad1ea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:25.435756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:25.436416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.436698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.436969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.437702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:25.438006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:25.439384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:25.447380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 571/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:25.453011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:25.545859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f988ba-3cec-438a-9311-c3a2c02293e2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:25.577363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:25.578154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.578427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.578691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] PATH_INFO: `/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.579871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5a5d09330b7143ca9a2d3a5d43d3fe8e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:25.581284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:25.582868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 587/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:25 2022] GET /identity/v3/users/5a5d09330b7143ca9a2d3a5d43d3fe8e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:25.588576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:25.686561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e33ae-9d11-45e1-b295-0fec54309605 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:25.718004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:25.718638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:25.718919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:25.719189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:25.781517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:25.782938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:25.882800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 572/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:25.888655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:25.980908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18153f-22b4-482a-aae4-503c09a303b8 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:26.011618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:26.012441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:26.012718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:26.012987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] PATH_INFO: `/v3/projects/98aeb75dbd3b4e90930756f6f508253d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:26.014153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] RBAC: Authorizing `identity:get_project(project_id=98aeb75dbd3b4e90930756f6f508253d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:26.015582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de4d2-9a31-48fc-b0b5-6d6104280793 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:26.017225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 588/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:25 2022] GET /identity/v3/projects/98aeb75dbd3b4e90930756f6f508253d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:26.023049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:26.116486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f282-90f4-4e7a-bb33-02f5712fec33 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:26.147555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:26.148130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:26.148415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:26.148690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:26.149505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=98aeb75dbd3b4e90930756f6f508253d, user.id=5a5d09330b7143ca9a2d3a5d43d3fe8e) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:26.149814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:26.151768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee65d8-7a06-411e-a59b-3c6460b10193 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:26.157272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 573/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:26 2022] GET /identity/v3/role_assignments?user.id=5a5d09330b7143ca9a2d3a5d43d3fe8e&scope.project.id=98aeb75dbd3b4e90930756f6f508253d&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:28.364113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1576f-7358-4447-95f8-ae709fbb8f31 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:28.364657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1576f-7358-4447-95f8-ae709fbb8f31 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:28.364657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1576f-7358-4447-95f8-ae709fbb8f31 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:28.366008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 589/1162] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:28.371212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:28.371650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:28.371796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:28.387987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:28.389187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:28.452611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 574/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:28.474648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1576f-7358-4447-95f8-ae709fbb8f31 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:28.568103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1576f-7358-4447-95f8-ae709fbb8f31 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:28.599929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:28.600554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:28.600833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:28.601100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:28.662348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:28.663794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:28.753688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 590/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:28.760217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:28.853761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48cea-323d-490a-8aa9-7df257c57bb8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:28.889661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:28.890474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:28.890751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:28.891022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:28.898110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:28.899554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-53e7a890-5471-4058-9a91-c3ba1565c686 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:28.914636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:28.915888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:28.917173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 575/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:27:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:27:28.921781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:29.018607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6240-f319-4653-80e2-f155d1758a28 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:29.050276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:29.050917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:29.051194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:29.051493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:29.052194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:29.052493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:29.053850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee6a30-4bbb-49a8-b7ab-4b9a0222a91a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:29.061078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 591/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Wed May 11 06:27:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:31.257789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637940-7c41-4a58-a277-b476806257eb None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:31.258432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637940-7c41-4a58-a277-b476806257eb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:31.258432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637940-7c41-4a58-a277-b476806257eb None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:31.259790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 576/1167] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:31.265239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068258-55af-42b9-8110-ee34275d7752 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:31.265657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068258-55af-42b9-8110-ee34275d7752 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:31.265798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068258-55af-42b9-8110-ee34275d7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:31.282359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d4068258-55af-42b9-8110-ee34275d7752 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:31.283570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d4068258-55af-42b9-8110-ee34275d7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:31.345543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 592/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:31.368826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b637940-7c41-4a58-a277-b476806257eb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:31.465779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b637940-7c41-4a58-a277-b476806257eb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:31.496454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:31.497095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:31.497370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:31.497635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:31.498389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:31.499763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d14cc-9d37-4f5e-a1e7-85703d1422be None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:31.514733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 577/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Wed May 11 06:27:31 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:33.797022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d25b-b71a-4963-9c23-2b365579dfd4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:33.797540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d25b-b71a-4963-9c23-2b365579dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:33.797540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d25b-b71a-4963-9c23-2b365579dfd4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:33.798837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 593/1170] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:33.804116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:33.804493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:33.804661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:33.821482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:33.822634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:33.883873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 578/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:27:33.906286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d25b-b71a-4963-9c23-2b365579dfd4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:34.000662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d25b-b71a-4963-9c23-2b365579dfd4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:34.031224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:34.032156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:34.032432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:34.032701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] PATH_INFO: `/v3/domains/67ecb9d0784b41db9c6f807f56cd94bd` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:34.042857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=67ecb9d0784b41db9c6f807f56cd94bd)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:34.044311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b554454-c65b-4384-8beb-a86b6e46af2c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:34.045914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 594/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Wed May 11 06:27:33 2022] GET /identity/v3/domains/67ecb9d0784b41db9c6f807f56cd94bd => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:34.051687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:34.147667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58a07-f14b-4023-91c4-8b56b9dd2587 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:34.179786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:34.180441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:34.180749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:34.181058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:34.181746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:34.183155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03491d-5e57-44cc-a3bb-7e58c445713c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:34.206439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 579/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:27:34 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:36.416729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8d81-7832-486d-8248-78fc4ff57c12 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:36.417263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8d81-7832-486d-8248-78fc4ff57c12 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:36.417263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b8d81-7832-486d-8248-78fc4ff57c12 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:36.418609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 595/1174] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:36.423781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:36.424225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:36.424326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:36.442046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:36.443521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:36.505973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 580/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:27:36.530380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b8d81-7832-486d-8248-78fc4ff57c12 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:36.624129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b8d81-7832-486d-8248-78fc4ff57c12 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:36.655030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:36.655890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:36.656166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:36.656433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] PATH_INFO: `/v3/domains/67ecb9d0784b41db9c6f807f56cd94bd` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:36.657569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67ecb9d0784b41db9c6f807f56cd94bd)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:36.658972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafbc7b-8cc9-4154-bf6c-20577bbba4a9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:36.660556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 596/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Wed May 11 06:27:36 2022] GET /identity/v3/domains/67ecb9d0784b41db9c6f807f56cd94bd => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:36.666637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:36.758563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d182-9c63-4d1e-a0ec-1f83c56a773c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:36.790074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:36.791244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:36.791558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:36.791831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:36.792524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:36.793945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b10e-a585-42ec-acf4-b6efa0d120ea None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:36.812964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 581/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:27:36 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:27:39.024985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44f0e7-55de-4960-ba95-e64b6de5be81 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.026091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44f0e7-55de-4960-ba95-e64b6de5be81 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.026091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44f0e7-55de-4960-ba95-e64b6de5be81 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.027462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 597/1178] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:39.032619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894187b-106a-48c5-b496-a02526de414a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.033062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894187b-106a-48c5-b496-a02526de414a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.033165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894187b-106a-48c5-b496-a02526de414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.049275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2894187b-106a-48c5-b496-a02526de414a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:39.050437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2894187b-106a-48c5-b496-a02526de414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:39.113130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 582/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:27:39.136508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44f0e7-55de-4960-ba95-e64b6de5be81 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:39.229662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44f0e7-55de-4960-ba95-e64b6de5be81 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:39.260293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:39.261060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.261335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.261604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.271374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:39.279527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:39.280699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:27:39.281782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 598/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:39.286497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894187b-106a-48c5-b496-a02526de414a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:39.378141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894187b-106a-48c5-b496-a02526de414a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:39.410204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:39.410865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.411146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.411475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.412217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:39.412518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:39.413870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:39.421634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 583/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:39.427336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:39.521172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26ffe-eb2e-4b83-98c0-6e4af888a0be None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:39.552025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:39.552817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.553093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.553361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] PATH_INFO: `/v3/users/c471764df32d49a482e71888c0f3de41` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.566758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] RBAC: Authorizing `identity:get_user(user_id=c471764df32d49a482e71888c0f3de41)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:39.568481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:39.570086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 599/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:39 2022] GET /identity/v3/users/c471764df32d49a482e71888c0f3de41 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:39.576459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:39.669735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd944-34e4-44ea-a98b-bab46d69bca5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:39.701101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:39.701727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.702008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.702279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.768801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:39.770230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:39.862165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 584/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:39.867966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:39.958777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b040-3455-4c6e-bbc7-fd3cac609a4d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:39.989576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:39.990402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:39.990673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:39.990935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] PATH_INFO: `/v3/projects/5c438dbf20d349ffba599025ca63b131` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:39.992111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] RBAC: Authorizing `identity:get_project(project_id=5c438dbf20d349ffba599025ca63b131)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:39.993511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f75c4-6fb3-419c-adfe-ac466e2a1d6a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:39.995807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 600/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:39 2022] GET /identity/v3/projects/5c438dbf20d349ffba599025ca63b131 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:40.001645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:40.094416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97998-56f5-44b7-8c04-a5f8c15d8b27 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:40.126387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:40.127029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:40.127337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:40.127614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:40.128429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=5c438dbf20d349ffba599025ca63b131, user.id=c471764df32d49a482e71888c0f3de41) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:40.128743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:40.130138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11153e-6c43-4c27-bde9-eaa6fc25e314 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:40.135393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 585/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:40 2022] GET /identity/v3/role_assignments?user.id=c471764df32d49a482e71888c0f3de41&scope.project.id=5c438dbf20d349ffba599025ca63b131&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:42.303443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97692-d555-4828-a24d-b51dd6a721ad None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.303971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97692-d555-4828-a24d-b51dd6a721ad None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.304082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97692-d555-4828-a24d-b51dd6a721ad None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.305374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 601/1186] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:42.310979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.311418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.311573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.328414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:42.329594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:42.391200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 586/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:42.413334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97692-d555-4828-a24d-b51dd6a721ad None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:42.506592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97692-d555-4828-a24d-b51dd6a721ad None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:42.537962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:42.538734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.539009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.539291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.548644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:42.556946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:42.558041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:27:42.559046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 602/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:42.564968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:42.656402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4536b-b04e-4d77-a535-acb4843facca None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:42.688271 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:42.688913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.689189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.689462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.690180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:42.690476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:42.691840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:42.699615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 587/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:42.705330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:42.796309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cc02-76a4-451f-92e0-117f7b0a9a08 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:42.827401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:42.828180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.828455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.828723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] PATH_INFO: `/v3/users/c471764df32d49a482e71888c0f3de41` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.829873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] RBAC: Authorizing `identity:get_user(user_id=c471764df32d49a482e71888c0f3de41)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:42.831308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:42.832872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 603/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:42 2022] GET /identity/v3/users/c471764df32d49a482e71888c0f3de41 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:42.838267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:42.931942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881369-4ef8-452b-9986-60fe922408c0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:42.963489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:42.964326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:42.964603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:42.964871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] PATH_INFO: `/v3/projects/5c438dbf20d349ffba599025ca63b131` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:42.966019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] RBAC: Authorizing `identity:get_project(project_id=5c438dbf20d349ffba599025ca63b131)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:42.967444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf47bf3-ddc8-495c-97b4-c3634608a08d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:42.969106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 588/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:42 2022] GET /identity/v3/projects/5c438dbf20d349ffba599025ca63b131 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:27:42.974627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:43.066685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d1b6f-5ecc-493b-884d-2263d713776c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:43.097631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:43.098437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:43.098715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:43.098985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] PATH_INFO: `/v3/projects/5c438dbf20d349ffba599025ca63b131/users/c471764df32d49a482e71888c0f3de41/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:43.101149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c438dbf20d349ffba599025ca63b131, user_id=c471764df32d49a482e71888c0f3de41, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:43.102550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5052-414a-44ef-b83e-fdb02b6f7050 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:43.114912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 604/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:27:42 2022] PUT /identity/v3/projects/5c438dbf20d349ffba599025ca63b131/users/c471764df32d49a482e71888c0f3de41/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:27:45.279586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f790f4-0023-4554-91c6-8db1f04b3bec None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.280142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f790f4-0023-4554-91c6-8db1f04b3bec None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.280142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f790f4-0023-4554-91c6-8db1f04b3bec None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:45.281490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 589/1193] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:27:45.286576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.286999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.287126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:45.303129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:27:45.304313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:27:45.365344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 605/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:27:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:27:45.388696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f790f4-0023-4554-91c6-8db1f04b3bec None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:45.483509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f790f4-0023-4554-91c6-8db1f04b3bec None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:45.515118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:45.515918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.516199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.516470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:45.526466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:27:45.534086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:27:45.535191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:27:45.536110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 590/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:27:45.541174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:45.632094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e15f1-1546-4fb1-8a98-c874869bdb34 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:45.664069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:45.664711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.664983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.665254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:45.666508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:45.666806 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:45.668188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:45.675664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 606/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:45.681299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:45.782314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d603e-e57f-4be6-a4e5-3e312cfd7589 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:45.812949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:45.813744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.814018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.814283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] PATH_INFO: `/v3/users/c471764df32d49a482e71888c0f3de41` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:45.815462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c471764df32d49a482e71888c0f3de41)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:45.816874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:45.818720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 591/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed May 11 06:27:45 2022] GET /identity/v3/users/c471764df32d49a482e71888c0f3de41 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:45.825265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:45.917716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f5a3-8f40-4140-a268-95f636b1721a None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:45.949119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:45.949745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:45.950027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:45.950301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:46.011868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:46.013290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:46.103512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 607/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:27:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:27:46.109170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:46.202097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30d9a0-02b4-46bd-9200-daba7f1ca6b2 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:46.232669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:46.233507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:46.233784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:46.234054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] PATH_INFO: `/v3/projects/5c438dbf20d349ffba599025ca63b131` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:46.235194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] RBAC: Authorizing `identity:get_project(project_id=5c438dbf20d349ffba599025ca63b131)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:46.236610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b51d3f-5232-4abd-a1fb-1461d6070b0f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:46.238254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 592/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed May 11 06:27:46 2022] GET /identity/v3/projects/5c438dbf20d349ffba599025ca63b131 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:27:46.244691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:27:46.335638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816891d-6319-4220-9b7c-f9f3fd46551d None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:27:46.366362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:27:46.366934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:27:46.367211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:27:46.367507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:27:46.368317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=5c438dbf20d349ffba599025ca63b131, user.id=c471764df32d49a482e71888c0f3de41) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:27:46.369163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:27:46.370578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958d586-034d-45ab-ab2b-ad3e54603fe0 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:27:46.376137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 608/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:27:46 2022] GET /identity/v3/role_assignments?user.id=c471764df32d49a482e71888c0f3de41&scope.project.id=5c438dbf20d349ffba599025ca63b131&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:46.638917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857616c-8712-4e2d-9238-982704a20470 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:46.639529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857616c-8712-4e2d-9238-982704a20470 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:46.639529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857616c-8712-4e2d-9238-982704a20470 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:46.641039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 593/1201] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:28:46.646257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:46.646705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:46.646805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:46.665778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:28:46.666945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:28:46.755367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 609/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:28:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:28:46.776402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857616c-8712-4e2d-9238-982704a20470 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:46.915499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857616c-8712-4e2d-9238-982704a20470 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:46.961687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:46.962491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:46.962790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:46.963054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:46.974322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:46.975882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:46.996305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:46.997336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:46.998312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:46.998312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:46.998312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:46.998312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:28:46.998312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 594/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:47.003564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:47.124942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1ff62-ef1d-4b9c-bd52-4cf73a1fd381 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:47.168241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:47.169053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:47.169362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:47.169696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:47.170520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:47.170864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:47.172543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54e273-fcb0-499e-b0fa-99f9f7da253d None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:47.186113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 610/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:28:47.192652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:47.309221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989878-f565-4b66-bf96-9712f623bc7d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:47.347562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:47.348327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:47.348606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:47.348970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:47.349718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:47.351577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad158-755a-44c4-88ff-7608892ca2a6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:47.391385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 595/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Wed May 11 06:28:47 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:28:50.009947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db45f-6560-4038-b66c-cdbe84edf8d5 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.010498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db45f-6560-4038-b66c-cdbe84edf8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.010498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db45f-6560-4038-b66c-cdbe84edf8d5 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.011898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 611/1206] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:28:50.017556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.017968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.018145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.037286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:28:50.038591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:28:50.111025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 596/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:28:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:28:50.135989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db45f-6560-4038-b66c-cdbe84edf8d5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:50.254526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db45f-6560-4038-b66c-cdbe84edf8d5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:50.288307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:50.289604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.290050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.290200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.301332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:28:50.309353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:50.310341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:50.311168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:50.315502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 612/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:50.316978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:50.429997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407432e-39d3-435d-943c-21f7673030c1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:50.467080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:50.467806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.468083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.468348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.469087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:50.469388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:50.470811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:50.480615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 597/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:50.486568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:50.592382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e725-a018-4e95-8440-9f975a0d1a9c None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:50.628610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:50.629552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.629926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.630247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.641593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:50.643229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:50.662770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:50.663956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:50.665033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:50.665033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:50.665033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:50.665033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:50.667500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 613/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:50.669917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:50.783314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560b38-71ce-46c8-8b24-e3e27091da4f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:50.820759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:50.821449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.821733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.822011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:50.822772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:50.823103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:50.824596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:50.840398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 598/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:50.847962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:50.957071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a131930-687d-4cb7-be44-b8415b30c6ce None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:50.996245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:50.997023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:50.997347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:50.997625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:51.005608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:51.009267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:28:51.026335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:51.028065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:28:51.029136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:51.032547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 614/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:51.033406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:51.137108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee357-9231-4c29-b6b2-6b573741263d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:51.179754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:51.180829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:51.181336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:51.181822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:51.182862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:51.183473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:51.185094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:51.203940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 599/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:28:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:51.209571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:51.317205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bb511-79f5-42ae-b338-1eae7149b3cd None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:51.351652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:51.352301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:51.352581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:51.352856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:51.424775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:51.427705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:51.535528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 615/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:28:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:28:51.542274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:51.657479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6865-28e3-4c02-8cd5-67d54ca306c9 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:51.699722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:51.700448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:51.700730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:51.701006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:51.712625 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:51.714073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:51.735578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:51.736819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:51.738381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:51.738381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:51.738381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:51.738381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:28:51.743303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 600/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:51.743475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:51.855555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea59b-41ba-40da-871c-cddabee566a2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:51.889903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:51.891171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:51.891833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:51.892367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:51.893398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:51.893991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:51.895801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:51.914268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 616/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:51.916433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:52.031348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753de8-06ec-4632-a4fa-4cb4f5cbab03 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:52.072035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:52.072871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:52.073154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:52.073449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:52.081874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:52.083384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:28:52.099310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:52.100267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:28:52.101419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 601/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:52.106140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:52.223273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04294deb-e712-434a-ad56-9a99ff7af7bc None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:52.267201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:52.268569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:52.268569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:52.268569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:52.269503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:52.269845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:52.271449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ad4b-8242-441d-b77f-ade6acc56236 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:52.286777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 617/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:52.293784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:52.419595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3dc3-0c9c-46d3-973b-74a549b11ba6 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:52.461412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:52.462068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:52.462356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:52.462620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:52.463467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=40643ca4e4db4ce6b0a692bb06cc6dc2) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:52.464006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:52.465167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6017fca-47b9-44ba-a9d8-af30eef28c1c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:52.471050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 602/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:28:52 2022] GET /identity/v3/role_assignments?user.id=40643ca4e4db4ce6b0a692bb06cc6dc2&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:28:54.697855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cfbc-d8b0-4b64-9809-29e832bc44ce None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:54.698373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cfbc-d8b0-4b64-9809-29e832bc44ce None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:54.698373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cfbc-d8b0-4b64-9809-29e832bc44ce None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:54.699857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 618/1220] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:28:54.704967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:54.705402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:54.705502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:54.722380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:28:54.723582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:28:54.792228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 603/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:28:54.814482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258cfbc-d8b0-4b64-9809-29e832bc44ce None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:54.925254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258cfbc-d8b0-4b64-9809-29e832bc44ce None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:54.961447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:54.962156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:54.962433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:54.962697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:54.973664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:28:54.981937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:54.982914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:54.984014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 619/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:54.989409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.100468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a2dc-6508-4705-8b8c-04bd7f0c6ba5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:55.138149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:55.138868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:55.139129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:55.139450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:55.140297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] RBAC: Adding query filter params (name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:55.140571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:55.141927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:55.152698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 604/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:55.158187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.276076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7dca7-3908-4da1-9880-23ed29998270 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:55.310913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:55.311738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:55.312012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:55.312280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:55.325615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:55.327559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:55.346024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:55.347050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:55.348033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:55.348033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:55.348033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:55.348033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:55.348033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 620/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:55.353828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.462128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681272d-1d39-4028-9f08-cd8cf6623e84 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:55.501020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:55.501809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:55.502093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:55.502460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:55.503327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:55.503841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:55.505445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:55.518441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 605/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:28:55.524947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.640771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd18e1-aed4-482f-8cf3-a7701d03db65 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:55.676076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:55.676872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:55.677164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:55.677443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:55.685750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:55.687984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:28:55.704444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:55.706070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:55.707103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 621/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:55.712388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.827272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7b349-fee9-449d-8b12-df25146fae65 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:55.861822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:55.862645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:55.863016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:55.863449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:55.864367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:55.864777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:55.866275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:55.883870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 606/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:28:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:28:55.889786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:55.998746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70e400-dad6-4be3-954b-277843c322b2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:56.038273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:56.039207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:56.039633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:56.039909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:56.051697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:56.053703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:56.073388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:56.074450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:56.075670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:56.075670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:56.075670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:56.075670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:56.075670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 622/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:56.080558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:56.187299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1161-04a0-4af4-98ee-2196847e5dbc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:56.223691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:56.224569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:56.224962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:56.225268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:56.226104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:56.226406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:56.227826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:56.240766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 607/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:56.247199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:56.351197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075008-dd18-42b8-922d-df06364cc61e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:56.385898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:56.386691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:56.386969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:56.387239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:56.394088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:56.395798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:28:56.411504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:56.412594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:28:56.413842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:28:56.418210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 623/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:56.419237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:56.527951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fb35-5059-4c02-8cff-76b0ae2d14c1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:56.566838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:56.568096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:56.568483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:56.568836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:56.569752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:56.570156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:56.571708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf07-1b6a-4c48-97e0-65d8544af49b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:56.585855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 608/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:56.592004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:56.697611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c5e7-3d4a-4f16-b3e0-4fc1a83c5de2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:56.732298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:56.733185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:56.733464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:56.733736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/40643ca4e4db4ce6b0a692bb06cc6dc2/roles/4f74ad4338904ddd8ef5354e7b658dab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:56.748340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=40643ca4e4db4ce6b0a692bb06cc6dc2, role_id=4f74ad4338904ddd8ef5354e7b658dab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:56.749796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f5eca-b567-4407-bcc9-03c6ba863573 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:56.761423 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 624/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:28:56 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/40643ca4e4db4ce6b0a692bb06cc6dc2/roles/4f74ad4338904ddd8ef5354e7b658dab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:28:59.146732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204e9a1-eb55-4e7b-bf26-6622e8e58594 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.147409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204e9a1-eb55-4e7b-bf26-6622e8e58594 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.147409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204e9a1-eb55-4e7b-bf26-6622e8e58594 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.149074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 609/1233] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:28:59.154044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.154428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.154620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.171623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:28:59.172827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:28:59.245259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 625/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:28:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:28:59.268859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204e9a1-eb55-4e7b-bf26-6622e8e58594 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:59.378355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204e9a1-eb55-4e7b-bf26-6622e8e58594 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:59.420175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:59.420894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.421176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.421449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.433023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:28:59.441431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:59.442628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:28:59.444160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 610/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Wed May 11 06:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:28:59.450570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:59.570554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1677-dd83-4674-a259-1cee788955c7 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:59.610196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:59.611009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.611414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.613666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.613666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] RBAC: Adding query filter params (name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:59.613666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:59.614219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:59.623883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 626/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Wed May 11 06:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:59.629435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:59.735595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb876d36-19b1-4697-abd1-c81ca904cb8a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:59.770300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:59.771102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.771417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.771694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.785676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:59.787139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:28:59.808836 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:28:59.809756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:28:59.811089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:28:59.811089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:28:59.811089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:28:59.811089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:28:59.811089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 611/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:28:59.816641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:28:59.924692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd450-7933-472d-b96f-0ce61032cb99 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:28:59.960370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:28:59.961062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:28:59.961347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:28:59.961625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:28:59.962363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:28:59.962662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:28:59.964081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:28:59.975821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 627/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:28:59.981856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:00.087074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c9c1a-7d68-4c06-8b91-18b1db5deb62 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:00.122273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:00.123157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:00.123473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:00.123750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:00.132646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:00.134084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:29:00.149320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:00.151010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:00.152297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 612/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:28:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:00.156454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:00.262344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942884c2-6716-4f9a-a21a-4acef3837dda None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:00.295779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:00.296464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:00.296743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:00.297013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:00.297841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:00.298142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:00.299600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:00.319291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 628/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:29:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:00.325098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:00.432144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de837-4a95-4029-a013-2e5f61b8a8b5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:00.467151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:00.467826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:00.468111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:00.468383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:00.537005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:00.539014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:00.646776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 613/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:29:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:29:00.653278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:00.754740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08f71-2e29-40d7-86a2-2598d6a2953f None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:00.790888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:00.791703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:00.791979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:00.792248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:00.802827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:00.804318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:00.821732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:00.822766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:00.823690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:00.823690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:00.823690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:00.823690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:00.823690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 629/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:00.829237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:00.930053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dfd8c-efec-4789-a2e8-c2c76b4ee62a None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:00.964768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:00.965491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:00.965784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:00.966059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:00.966778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:00.967085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:00.968524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:00.980468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 614/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:00.986133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:01.086074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7732c0-7ae2-4265-924e-8e8dc7239ddb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:01.121793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:01.122642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:01.122891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:01.123173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:01.130401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:01.131900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:29:01.146697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:01.148378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:01.149306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 630/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:01.154768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:01.260690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d945fe6-d654-4678-ab1c-e39779644a56 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:01.298926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:01.299616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:01.299910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:01.300173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:01.300959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:01.301262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:01.302674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81da437-839b-4c16-b835-aa2249221c63 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:01.314549 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 615/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:01.323251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:01.437976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f5d2-6fe7-4937-b106-5f484ac9730e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:01.475114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:01.475824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:01.476102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:01.476373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:01.477200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] RBAC: Adding query filter params (role.id=4f74ad4338904ddd8ef5354e7b658dab, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=40643ca4e4db4ce6b0a692bb06cc6dc2) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:01.477511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:01.478941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e98b-9401-484f-a8fe-1cac80827881 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:01.485299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 631/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:29:01 2022] GET /identity/v3/role_assignments?user.id=40643ca4e4db4ce6b0a692bb06cc6dc2&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=4f74ad4338904ddd8ef5354e7b658dab => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:29:03.871830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987ca15-5407-4507-bb8d-3d29cef37398 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:03.872531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987ca15-5407-4507-bb8d-3d29cef37398 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:03.872531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987ca15-5407-4507-bb8d-3d29cef37398 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:03.873796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 616/1247] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:03.879034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:03.879518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:03.879628 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:03.898089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:03.899455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:03.966265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 632/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:29:03.989305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987ca15-5407-4507-bb8d-3d29cef37398 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.100232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987ca15-5407-4507-bb8d-3d29cef37398 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.136937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.137725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.138111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.138358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.149501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:29:04.157734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:04.158979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:04.160265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 617/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:29:04.165575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.270395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bab8-9610-49d8-943c-4ac1a755f0dd None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.306894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.307600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.307871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.308139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.308873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:04.309184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:04.310607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:04.318881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 633/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:04.325428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.432470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1e8c-8537-47eb-9f1a-f9b0af37aba7 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.466574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.467389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.467669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.467940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.479696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:04.481275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:04.498820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:04.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:04.500897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:04.500897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:04.500897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:04.500897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:04.500897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 618/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:04.506210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.623157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a385e-5b0b-42f9-8b3c-08c4f5f068e9 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.657071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.657728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.658000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.658289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.659078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:04.659418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:04.660855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:04.672919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 634/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:04.678832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.786301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5505-e5e9-436c-987c-e0a8602f7fc1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.821702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.822668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.823180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.823539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.832353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:04.834089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:29:04.850600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:04.851687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:04.852997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 619/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:04.858117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:04.955699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b782-96e8-4599-91d3-72d74f89b5c2 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:04.990496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:04.991150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:04.991520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:04.991794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:04.992623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:04.992923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:04.994346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.015314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 635/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:29:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:05.020072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:05.125229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253860b0-ca4b-46e4-945e-5554ec0454a1 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:05.160137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:05.160790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:05.161067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:05.161338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:05.230213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:05.231774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.330571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 620/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:29:05.336425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:05.435108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e601cc-f41e-4dc7-9ff8-22a271500e9b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:05.469402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:05.470201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:05.470484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:05.470763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:05.480769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:05.482209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:05.499925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:05.500811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:05.501685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:05.501685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:05.501685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:05.501685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:05.501685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 636/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:05.507499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:05.614425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b48ae-4332-4bec-a35f-d5e7dba482a3 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:05.646970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:05.647678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:05.647956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:05.648226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:05.648934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:05.649236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:05.650576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.661113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 621/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:05.667155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:05.760669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1cfd-2a11-418a-afa7-dbc0989a02af None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:05.792277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:05.793057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:05.793344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:05.793620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:05.799948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:05.801375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:29:05.815249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:05.816322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:05.817421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 637/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:05.822443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:05.914805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad98fe-976c-4ba7-b47c-5c480476985d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:05.946113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:05.946760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:05.947040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:05.947336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:05.948105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:05.948411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:05.949814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f96b0f-820b-4e91-aee2-be093eca750b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:05.961555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 622/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:05.967385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:06.061013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff5e3f-39dc-41fa-a3d4-c83c79b197f6 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:06.091801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:06.092434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:06.092708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:06.092977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:06.093791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=40643ca4e4db4ce6b0a692bb06cc6dc2) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:06.094094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:06.095517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa79503-f3f5-4933-8295-248dfb6bbd98 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:06.101238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 638/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:29:05 2022] GET /identity/v3/role_assignments?user.id=40643ca4e4db4ce6b0a692bb06cc6dc2&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:08.257934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abf-37fc-409e-84fb-641b5e508f10 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.258456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abf-37fc-409e-84fb-641b5e508f10 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.258456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47abf-37fc-409e-84fb-641b5e508f10 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.259877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 623/1261] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:08.264860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.265308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.265414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.282006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:08.283159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:08.345209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 639/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:29:08.367817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe47abf-37fc-409e-84fb-641b5e508f10 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:08.466486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe47abf-37fc-409e-84fb-641b5e508f10 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:08.498263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:08.499043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.499347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.499620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.509204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:29:08.516716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:08.517794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:08.518673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 624/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:08.524547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:08.629889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd214d3a-83e1-436b-bcec-32d329a6c2fe None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:08.662885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:08.663582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.663858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.664123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.664845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:08.665141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:08.666483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:08.673950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 640/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:08.679807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:08.773580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd17be2-8157-4f64-9caf-5a084e4e638d None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:08.803862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:08.804622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.804899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.805173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.814958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:08.816404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:08.833116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:08.834157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:08.835818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:08.835818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:08.835818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:08.835818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:08.835818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 625/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:08.840348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:08.932220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc386-f9c0-4122-b92e-2d4f4b50a0b1 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:08.963580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766611-e452-40a4-b429-20779969232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:08.964225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766611-e452-40a4-b429-20779969232e None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:08.964501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766611-e452-40a4-b429-20779969232e None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:08.964770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33766611-e452-40a4-b429-20779969232e None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:08.965479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766611-e452-40a4-b429-20779969232e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:08.965779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766611-e452-40a4-b429-20779969232e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:08.967127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33766611-e452-40a4-b429-20779969232e None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:08.978295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 641/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:08.983764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.077857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1bd80-8aa2-402e-ac32-1ead138c97fc None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.108655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.109438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.109720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.109994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] PATH_INFO: `/v3/users/placement` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.118305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.119758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:29:09.134045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:09.135117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:09.136487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 626/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:09.140704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766611-e452-40a4-b429-20779969232e None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.233128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33766611-e452-40a4-b429-20779969232e None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.263927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.264571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.264851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.265121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.265949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:09.266254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.267705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.284138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 642/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:29:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:09.289970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.381108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4597-3f23-495c-afe8-b8cf641f68be None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.412428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.413227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.413501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.413771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.423693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.425133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:09.441224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:09.442246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:09.443441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:09.443441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:09.443441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:09.443441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:09.443441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 627/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:09.449562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.545987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb91e21-f897-408e-8079-6dd377c20f68 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.582291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.582941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.583223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.583523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.584232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:09.584535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.586477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.597037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 643/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:09.602609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.696153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5b3c-b7b5-4de6-bbca-ba5bc4c5352c None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.726847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.727660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.727942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.728215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.734543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.735990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:29:09.750131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:09.751109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:09.752053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 628/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:09.757517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.848798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591f94d-92a2-4aa1-983a-3d36e7ab5502 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:09.879726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:09.880356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:09.880631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:09.880898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:09.881682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:09.882495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:09.883919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e336f2-1bab-4f26-9ace-56339f3669e6 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:09.894959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 644/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:09.900687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:09.992807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924aeb4-f67f-497f-813d-1ad29271b56f None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:10.025076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:10.025935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:10.026212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:10.026482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] PATH_INFO: `/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/40643ca4e4db4ce6b0a692bb06cc6dc2/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:10.028399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] RBAC: Authorizing `identity:create_grant(project_id=e744a9413ae44999bc4a9c57c7a2389b, user_id=40643ca4e4db4ce6b0a692bb06cc6dc2, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:10.029802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897e80-5cc9-436e-b592-c4324a00b45b None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:10.042657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 629/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Wed May 11 06:29:09 2022] PUT /identity/v3/projects/e744a9413ae44999bc4a9c57c7a2389b/users/40643ca4e4db4ce6b0a692bb06cc6dc2/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:29:12.181214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395bf1-3123-4afb-97da-45398215bb4a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.181793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395bf1-3123-4afb-97da-45398215bb4a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.181793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395bf1-3123-4afb-97da-45398215bb4a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.183109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 645/1274] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:12.188189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.188566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.188738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.205587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:12.206740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:12.267920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 630/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:29:12.290499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395bf1-3123-4afb-97da-45398215bb4a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:12.386297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395bf1-3123-4afb-97da-45398215bb4a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:12.419736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:12.420520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.420795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.421090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.431207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 06:29:12.438771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:12.439882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:12.441095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 646/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Wed May 11 06:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 06:29:12.446056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:12.540446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475590a-9d0a-4264-8bfb-3731c9b0b44f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:12.579017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:12.579805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.580109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.580458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.581225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:12.581592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:12.583104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:12.592053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 631/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed May 11 06:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:29:12.597760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:12.691723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca09d1-e213-414e-815a-d49a824dd361 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:12.722917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:12.723727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.724008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.724281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.734797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:12.736263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:12.752873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:12.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:12.754933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:12.754933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:12.754933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:12.754933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:12.754933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 647/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:12.759643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:12.853248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff75-621b-4eaf-8f84-bc6add5fb7d5 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:12.883449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:12.884084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:12.884359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:12.884626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:12.885320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:12.885616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:12.886936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:12.898364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 632/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:12.903760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:12.996163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9ffb-4209-4c98-b633-83cd0729a3e7 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.027412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.028184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.028463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.028733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.035758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.037176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 06:29:13.051553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:13.052617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:13.053783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 648/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:13.058327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:13.150288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c52cd6-48c0-435c-bcad-bec5c33e9918 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.180885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.181530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.181807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.182077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.182892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:13.183195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.184616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.201238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 633/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:13.206828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:13.299245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff5ca-8b22-4c23-9a5e-f46241f8d22b None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.329971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.330594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.330866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.331129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.392238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.393664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.485863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 649/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 06:29:13.492166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:13.590931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e6ed-d0b9-4d65-bf3d-d2aa99f9d716 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.622699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.623505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.623785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.624055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.634026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.635461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 06:29:13.652694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:13.653736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:13.654871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 06:29:13.654871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 06:29:13.654871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 06:29:13.654871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:13.654871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 634/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:13.659505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:13.750450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23873-f8b7-480e-a12e-d3596975e502 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.781659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.782300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.782576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.782849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.783620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:13.783921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.785266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.796383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 650/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:13.801794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:13.895395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78333-54ba-464c-8727-00ee0bd0faf0 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:13.927069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:13.927878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:13.928163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:13.928466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:13.934780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:13.936233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 06:29:13.950266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application with Lock( May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:13.951293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: ERROR keystone.server.flask.application May 11 06:29:13.952226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 635/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:13.956888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:14.050073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890f19-af83-4baa-b727-32fe59184294 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:14.081389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:14.082029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:14.082310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:14.082584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:14.083383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:14.083692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:14.085674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190d9a6-64d7-4366-8ab2-2ca16a470924 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:14.096899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 651/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Wed May 11 06:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:14.102543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:14.197365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79df2a-d03c-4bed-aeec-f80e2c850f67 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:14.227968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644439-ba01-4132-8b18-072839056170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:14.228601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644439-ba01-4132-8b18-072839056170 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:14.228877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644439-ba01-4132-8b18-072839056170 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:14.229146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644439-ba01-4132-8b18-072839056170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:14.229961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644439-ba01-4132-8b18-072839056170 None admin] RBAC: Adding query filter params (role.id=991b05c688cb448e83689717b7104be0, scope.project.id=e744a9413ae44999bc4a9c57c7a2389b, user.id=40643ca4e4db4ce6b0a692bb06cc6dc2) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:14.230267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644439-ba01-4132-8b18-072839056170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:14.231692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644439-ba01-4132-8b18-072839056170 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:14.237205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 636/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Wed May 11 06:29:14 2022] GET /identity/v3/role_assignments?user.id=40643ca4e4db4ce6b0a692bb06cc6dc2&scope.project.id=e744a9413ae44999bc4a9c57c7a2389b&role.id=991b05c688cb448e83689717b7104be0 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:16.426830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7313d3-db4c-4c02-8759-83cb77f2b963 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:16.427365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7313d3-db4c-4c02-8759-83cb77f2b963 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:16.427454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7313d3-db4c-4c02-8759-83cb77f2b963 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:16.429256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 652/1288] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:16.434575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:16.434972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:16.435124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:16.452119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:16.453286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:16.515593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 637/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 06:29:16.537633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7313d3-db4c-4c02-8759-83cb77f2b963 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:16.641428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7313d3-db4c-4c02-8759-83cb77f2b963 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:16.672529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:16.673316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:16.673589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:16.673853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:16.674493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:16.675877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:16.687851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:16.689021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:16.689880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 653/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:29:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:16.695815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:16.787584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507e12-6b94-45d3-9447-fa1079603600 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:16.820071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:16.820750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:16.821034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:16.821308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:16.822038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:16.822343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:16.823734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e467-d50d-4013-9860-aaab4ea8fdb1 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:16.828341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 638/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Wed May 11 06:29:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:16.834119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:16.925414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c7a0-430f-4acd-a02a-dfdcf954a8bb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:16.956380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:16.956951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:16.957226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:16.957493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] PATH_INFO: `/v3/services` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:16.958174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:16.958471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:16.959867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38652f-83c3-48e2-9c1e-3809bbd3f406 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:16.964002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 654/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Wed May 11 06:29:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:19.151705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a245-2462-4b2b-bd52-9e139a21eb8a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:19.152245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a245-2462-4b2b-bd52-9e139a21eb8a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:19.152245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a245-2462-4b2b-bd52-9e139a21eb8a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:19.153619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 639/1293] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:19.158711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3084f-f1ad-4898-a5d6-7a715837a999 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:19.159101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3084f-f1ad-4898-a5d6-7a715837a999 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:19.159256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3084f-f1ad-4898-a5d6-7a715837a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:19.175757 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b4f3084f-f1ad-4898-a5d6-7a715837a999 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:19.176914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b4f3084f-f1ad-4898-a5d6-7a715837a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:19.238148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 655/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:29:19.260598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4a245-2462-4b2b-bd52-9e139a21eb8a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:19.355148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4a245-2462-4b2b-bd52-9e139a21eb8a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:19.386599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:19.387239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:19.387549 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:19.387820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:19.388539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:19.389875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f19dd-8229-454c-86e9-ede0590b152d None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:19.402252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 640/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Wed May 11 06:29:19 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:29:21.642760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544069-b9eb-4781-8738-3d8d1bfe7d1c None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:21.643313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544069-b9eb-4781-8738-3d8d1bfe7d1c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:21.643313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544069-b9eb-4781-8738-3d8d1bfe7d1c None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:21.644790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 656/1296] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:21.650582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:21.651002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:21.651122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:21.667408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:21.668562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:21.738760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 641/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:29:21.762930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544069-b9eb-4781-8738-3d8d1bfe7d1c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:21.856876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544069-b9eb-4781-8738-3d8d1bfe7d1c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:21.888895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:21.889673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:21.889952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:21.890225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:21.890866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:21.892255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:21.903742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:21.904869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:21.905735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 657/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:29:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:21.910774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:22.003318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbcebe-31e0-4268-9c08-af510defdd75 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:22.039590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:22.040256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:22.040538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:22.040810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:22.041506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:22.041809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:22.043163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:22.048163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 642/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Wed May 11 06:29:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:22.054631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:22.145153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88599b-196d-4e91-919e-aa3266b81797 None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:22.175654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:22.176279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:22.176554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:22.176823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:22.177587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] RBAC: Adding query filter params (interface=public, service_id=5fd1579ece3641b9b061155a293d86b1, region_id=RegionOne) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:22.177891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:22.179871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afb35-6f5e-4a80-957b-630e5491b02a None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:22.184539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 658/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Wed May 11 06:29:22 2022] GET /identity/v3/endpoints?service_id=5fd1579ece3641b9b061155a293d86b1&interface=public®ion_id=RegionOne => generated 194 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:22.189979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:22.283076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459da25-72f5-49fd-9d64-5088eb784f13 None admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:22.315272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:22.315933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:22.316214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:22.316485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:22.317164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:22.318838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86ccc1-a1d9-473e-a1ce-1aae80a96f46 None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:22.325371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 643/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Wed May 11 06:29:22 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:29:24.496835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e221-1d46-4ec0-a0d0-59a00104ca1d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:24.497323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e221-1d46-4ec0-a0d0-59a00104ca1d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:24.497413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13e221-1d46-4ec0-a0d0-59a00104ca1d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:24.498740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 659/1302] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:29:24.503865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:24.504230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:24.504415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:24.520923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:29:24.522696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:29:24.595943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 644/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:29:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 06:29:24.618163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13e221-1d46-4ec0-a0d0-59a00104ca1d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:24.714565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13e221-1d46-4ec0-a0d0-59a00104ca1d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:24.745217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:24.745998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:24.746277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:24.746549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] PATH_INFO: `/v3/services/placement` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:24.747187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:24.748565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 06:29:24.760581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 06:29:24.761728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.get_or_create( May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application with Lock( May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self._enter() May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application return self.creator() May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application created_value = creator( May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: ERROR keystone.server.flask.application May 11 06:29:24.762766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 660/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Wed May 11 06:29:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 06:29:24.767840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:24.858298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57bce-0ce0-447b-8c5c-7654dfca7efe None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:24.890222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:24.890866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:24.891147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:24.891452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] PATH_INFO: `/v3/services` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:24.892146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] RBAC: Adding query filter params (name=placement) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:29:24.892449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:24.893800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59c8f9-7d94-428b-b0f4-a15da230b63a None admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:24.898712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 645/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Wed May 11 06:29:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:29:24.904207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:29:24.997001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7280-a3e3-4859-bd68-cbedadc355fb None admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:29:25.027679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:29:25.028301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:29:25.028577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:29:25.028847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:29:25.029558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:29:25.030895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c211d2b-26c0-4e14-9b93-69946c259b8c None admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:29:25.049722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 661/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed May 11 06:29:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:30:28.407720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f613d-ba03-4a10-9b5a-7f29ea75e5e5 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:28.408692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f613d-ba03-4a10-9b5a-7f29ea75e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:28.409185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f613d-ba03-4a10-9b5a-7f29ea75e5e5 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:28.415235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 646/1307] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:28.416545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9927-51d4-4935-9793-a089c5dfefc5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:28.418515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9927-51d4-4935-9793-a089c5dfefc5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:28.418950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9927-51d4-4935-9793-a089c5dfefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:28.520043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b57d9927-51d4-4935-9793-a089c5dfefc5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:28.521498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b57d9927-51d4-4935-9793-a089c5dfefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:28.707866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 662/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:30:28.750271 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:28.750744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:28.751190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:28.753359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 647/1309] 10.222.0.64 () {54 vars in 964 bytes} [Wed May 11 06:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:28.765707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343aaa-06bf-4771-b165-bd92c68d603c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:28.766278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343aaa-06bf-4771-b165-bd92c68d603c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:28.767582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343aaa-06bf-4771-b165-bd92c68d603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:28.929463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-32343aaa-06bf-4771-b165-bd92c68d603c None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:28.930676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-32343aaa-06bf-4771-b165-bd92c68d603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:29.064564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 663/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Wed May 11 06:30:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:29.097498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:29.101100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:29.306131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e5bb6-8367-4f3c-8031-c184da4e3361 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:29.421567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:29.423017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:29.423577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:29.424216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:29.426172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:29.556505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:29.558189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b3f9f-02fd-4e3c-acf3-f94a9618c88e service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:29.597422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 648/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:32.294504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a551-41b4-45ab-ad66-e1a16063a3e4 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:32.294978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a551-41b4-45ab-ad66-e1a16063a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:32.295590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a551-41b4-45ab-ad66-e1a16063a3e4 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:32.303235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5165-612b-47cd-b505-ca955c6a3094 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:32.304028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5165-612b-47cd-b505-ca955c6a3094 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:32.304449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5165-612b-47cd-b505-ca955c6a3094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:32.307448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 664/1312] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:32.398904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6f5d5165-612b-47cd-b505-ca955c6a3094 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:32.400163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6f5d5165-612b-47cd-b505-ca955c6a3094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:32.531926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 649/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:32.599592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:32.599880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:32.600160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:32.601841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 665/1314] 10.222.0.64 () {54 vars in 964 bytes} [Wed May 11 06:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:32.612992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99068-63a9-420f-acc3-5426ef588202 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:32.613495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99068-63a9-420f-acc3-5426ef588202 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:32.613840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c99068-63a9-420f-acc3-5426ef588202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:32.727003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-61c99068-63a9-420f-acc3-5426ef588202 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:32.728421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-61c99068-63a9-420f-acc3-5426ef588202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:32.809131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 650/1315] 10.222.0.64 () {58 vars in 1061 bytes} [Wed May 11 06:30:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:32.819187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:32.821001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:32.932020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628a98-f92a-466b-abbd-d03aaad1fd10 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:33.009364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:33.009984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:33.010258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:33.010524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:33.012180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:33.131099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:33.132610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ffd-ae90-4624-8a3c-4e554bf06920 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:33.151630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 666/1316] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:35.958137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:35.958731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:35.958731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:35.963302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 651/1317] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:35.965549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d942-633c-4081-8887-b747f57b03bb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:35.965976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d942-633c-4081-8887-b747f57b03bb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:35.966168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d942-633c-4081-8887-b747f57b03bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:36.030276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4241d942-633c-4081-8887-b747f57b03bb None None] MFA Rules not processed for user `cdd044c2ea3248288976374719a9f803`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:36.031510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4241d942-633c-4081-8887-b747f57b03bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:36.124060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 667/1318] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:36.163607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:36.165116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:36.268215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8617b7-573d-4f72-b15d-5450fc5a861a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:36.339359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:36.340019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:36.340301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:36.340582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:36.342211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:36.447959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:36.449394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5a3d9-001a-4f55-b210-d4187b500e5d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:36.467217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 652/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:39.208018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:39.208575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:39.208575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:39.209897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 668/1320] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:39.214985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ba16-87cf-4103-b0b2-572277386644 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:39.215449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ba16-87cf-4103-b0b2-572277386644 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:39.215576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ba16-87cf-4103-b0b2-572277386644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:39.277846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f3d7ba16-87cf-4103-b0b2-572277386644 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:39.279044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f3d7ba16-87cf-4103-b0b2-572277386644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:39.372029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 653/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:39.410461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:39.412028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:39.510635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89df03-898e-4827-8f0c-eaf74ea1e10d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:39.584483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:39.585115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:39.585385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:39.585647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:39.587257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:39.688008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:39.689463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74b4af-f707-41ab-a798-3e5b37c19b5f service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:39.706864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 669/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:42.533929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:42.534454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:42.534454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:42.539313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 654/1323] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:42.541711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf23d9-82b3-4087-84b3-0b42f532fc8d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:42.542497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf23d9-82b3-4087-84b3-0b42f532fc8d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:42.542775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf23d9-82b3-4087-84b3-0b42f532fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:42.604322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2ecf23d9-82b3-4087-84b3-0b42f532fc8d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:42.605494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2ecf23d9-82b3-4087-84b3-0b42f532fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:42.697253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 670/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:30:42.731546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:42.733063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:42.832649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005d31-12e2-4149-b4b3-0e63c264efaa None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:42.903227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:42.903890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:42.904164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:42.904429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:42.906028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:43.009194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:43.010537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0209fc-6cf6-4dec-8ef6-7e4cd3760a10 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:43.027680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 655/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:30:45.308293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:45.308860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:45.308860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:45.310207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 671/1326] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:45.315953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521544-b008-413b-a5e7-df4ace6916ed None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:45.316477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521544-b008-413b-a5e7-df4ace6916ed None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:45.316602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2521544-b008-413b-a5e7-df4ace6916ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:45.381426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e2521544-b008-413b-a5e7-df4ace6916ed None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:45.382609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e2521544-b008-413b-a5e7-df4ace6916ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:45.476709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 656/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:45.511999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:45.513517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:45.614589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c98a3-426d-4ae4-bee6-6734ec95fe15 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:45.683699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:45.684354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:45.684633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:45.684907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:45.686528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:45.794289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:45.795689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6f94e-4c43-40e8-96fb-35461b032918 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:45.812759 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 672/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:48.084153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:48.084730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:48.084730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:48.086061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 657/1329] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:48.091252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1f5-fda9-4e43-a754-592eaff29124 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:48.091710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1f5-fda9-4e43-a754-592eaff29124 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:48.091962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1f5-fda9-4e43-a754-592eaff29124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:48.153916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5fe2f1f5-fda9-4e43-a754-592eaff29124 None None] MFA Rules not processed for user `cdd044c2ea3248288976374719a9f803`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:48.155098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5fe2f1f5-fda9-4e43-a754-592eaff29124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:48.246875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 673/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:48.283614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:48.285207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:48.385919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7235985-7079-426a-88b3-570c48f65d02 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:48.461480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:48.462125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:48.462404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:48.462676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:48.464841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:48.570631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:48.572225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70134ca-fe16-479e-ab56-69dd7405077b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:48.590012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 658/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:51.201426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:51.201942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:51.202063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:51.203372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 674/1332] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:51.209210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e7e-8b94-48a0-b6ec-5741e01e929b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:51.209593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e7e-8b94-48a0-b6ec-5741e01e929b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:51.209785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e7e-8b94-48a0-b6ec-5741e01e929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:51.276686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-20989e7e-8b94-48a0-b6ec-5741e01e929b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:51.277884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-20989e7e-8b94-48a0-b6ec-5741e01e929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:51.375047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 659/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:51.411825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:51.413374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:51.515543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec91a3-017f-45e9-98ca-6606065ec39d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:51.588865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:51.589516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:51.589801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:51.590076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:51.591748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:51.702815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:51.704280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68f71e-972e-42d0-b8dd-a135d048db8a service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:51.722420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 675/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:54.021483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:54.022054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:54.022054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:54.023477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 660/1335] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:54.030003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae060b-59ce-4d8b-abf3-db4f76126634 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:54.030427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae060b-59ce-4d8b-abf3-db4f76126634 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:54.030552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae060b-59ce-4d8b-abf3-db4f76126634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:54.094696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-30ae060b-59ce-4d8b-abf3-db4f76126634 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:54.095913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-30ae060b-59ce-4d8b-abf3-db4f76126634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:54.186159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 676/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:30:54.226067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:54.227633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:54.325188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c646d-8e91-4ff1-8a0c-7b5f58e0091f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:54.397358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:54.397995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:54.398273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:54.398540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:54.400191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:54.502487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:54.503929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e19ed6-c28c-471b-88ce-33558dca52b6 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:54.522184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 661/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:30:57.159560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:57.160087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:57.160087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:57.161559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 677/1338] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:30:57.167239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee8a7-4da9-443d-8f13-4fe3fbe95e70 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:57.174222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee8a7-4da9-443d-8f13-4fe3fbe95e70 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:57.174222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee8a7-4da9-443d-8f13-4fe3fbe95e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:57.234552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1b2ee8a7-4da9-443d-8f13-4fe3fbe95e70 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:30:57.235772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1b2ee8a7-4da9-443d-8f13-4fe3fbe95e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:57.332485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 662/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:30:57.367805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:30:57.369321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:57.467086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f2821-f6d2-4802-91e9-3246d32b0a75 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:30:57.538310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:30:57.539354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:30:57.539778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:30:57.540085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:30:57.542379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:30:57.644809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:30:57.646805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f8d2f-21fa-4150-9c22-b175c2529ba2 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:30:57.663804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 678/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:30:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:01.927482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:01.928030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:01.928030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:01.929803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 663/1341] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:01.935535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288c45-3c8c-4d9f-9545-bb7f1d3ad0ec None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:01.936000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288c45-3c8c-4d9f-9545-bb7f1d3ad0ec None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:01.936105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288c45-3c8c-4d9f-9545-bb7f1d3ad0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:02.007642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1e288c45-3c8c-4d9f-9545-bb7f1d3ad0ec None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:02.008752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1e288c45-3c8c-4d9f-9545-bb7f1d3ad0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:02.108348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 679/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:02.150460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:02.152634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:02.244501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e94252-7ef6-4d36-8ae2-4995924c1125 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:02.248007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:02.248651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:02.248927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:02.249194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:02.258354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:02.259790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611729c-ea84-43c4-a648-004f9d69f023 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:02.268748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 664/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:05.096380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:05.096922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:05.096922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:05.098838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 680/1344] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:05.104205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261678b-3d3e-4ae4-a8f4-54d103ff59ea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:05.104600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261678b-3d3e-4ae4-a8f4-54d103ff59ea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:05.104762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261678b-3d3e-4ae4-a8f4-54d103ff59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:05.131926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6261678b-3d3e-4ae4-a8f4-54d103ff59ea None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:05.133111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6261678b-3d3e-4ae4-a8f4-54d103ff59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:05.206607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 665/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:05.243570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:05.245236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:05.257909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b7fa4-0068-4221-bff0-da2b0bc7913c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:05.261666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:05.262365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:05.262716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:05.263059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:05.272797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:05.274212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a678b-aca4-4d40-b74b-56165138d7ce service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:05.283502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 681/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:31:09.815341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a58f8-9225-4a65-b79e-907d88b7b9fe None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:09.815910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a58f8-9225-4a65-b79e-907d88b7b9fe None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:09.816075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a58f8-9225-4a65-b79e-907d88b7b9fe None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:09.817564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 666/1347] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:09.823041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df2fd-78f8-42c0-a0be-aa593efab457 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:09.823524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df2fd-78f8-42c0-a0be-aa593efab457 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:09.823754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df2fd-78f8-42c0-a0be-aa593efab457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:09.841553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cc0df2fd-78f8-42c0-a0be-aa593efab457 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:09.842719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cc0df2fd-78f8-42c0-a0be-aa593efab457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:09.850881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 682/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:09.887367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a58f8-9225-4a65-b79e-907d88b7b9fe None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:09.898455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a58f8-9225-4a65-b79e-907d88b7b9fe None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:09.901941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:09.902578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:09.902858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:09.903130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:09.912589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:09.914004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5845-f5b2-405c-8c08-12fac00a0e90 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:09.923325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 667/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:15.244538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eeff-105e-494e-9014-3164927bb2de None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:15.245578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eeff-105e-494e-9014-3164927bb2de None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:15.246006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436eeff-105e-494e-9014-3164927bb2de None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:15.247832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 683/1350] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:15.252904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655442-ee9a-4d58-bd4c-2dcdfb00c004 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:15.253329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655442-ee9a-4d58-bd4c-2dcdfb00c004 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:15.253491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655442-ee9a-4d58-bd4c-2dcdfb00c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:15.369590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3e655442-ee9a-4d58-bd4c-2dcdfb00c004 None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:15.372828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3e655442-ee9a-4d58-bd4c-2dcdfb00c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:15.585859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 668/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:31:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:19.702355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5010-0687-4034-a43e-a8f83feb3684 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:19.703228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5010-0687-4034-a43e-a8f83feb3684 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:19.703798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5010-0687-4034-a43e-a8f83feb3684 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:19.705733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 684/1352] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:19.711059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d5aa-a954-4dac-8152-1d4596768ae1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:19.711859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d5aa-a954-4dac-8152-1d4596768ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:19.712311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d5aa-a954-4dac-8152-1d4596768ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:19.731514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-00f1d5aa-a954-4dac-8152-1d4596768ae1 None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:19.733027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-00f1d5aa-a954-4dac-8152-1d4596768ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:19.742212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 669/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:31:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:21.284219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06f93-4a41-44db-b10c-be3babe38b87 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:21.284646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06f93-4a41-44db-b10c-be3babe38b87 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:21.285052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf06f93-4a41-44db-b10c-be3babe38b87 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:21.287076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 685/1354] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:21.292163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49ed6-ed5f-4823-8440-a01570d20d79 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:21.292583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49ed6-ed5f-4823-8440-a01570d20d79 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:21.292713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49ed6-ed5f-4823-8440-a01570d20d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:21.311098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d9d49ed6-ed5f-4823-8440-a01570d20d79 None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:21.312318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d9d49ed6-ed5f-4823-8440-a01570d20d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:21.321637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 670/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:31:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:25.144456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911f16-8534-4291-b794-bdec2271ceae None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:25.145028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911f16-8534-4291-b794-bdec2271ceae None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:25.145616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911f16-8534-4291-b794-bdec2271ceae None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:25.149276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 686/1356] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:25.153683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647fc-c643-49ec-bbcc-94d7033c17ac None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:25.154151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647fc-c643-49ec-bbcc-94d7033c17ac None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:25.154378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471647fc-c643-49ec-bbcc-94d7033c17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:25.172752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-471647fc-c643-49ec-bbcc-94d7033c17ac None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:25.174106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-471647fc-c643-49ec-bbcc-94d7033c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:25.182902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 671/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:25.231233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5baea-727d-48c4-b58b-4c106b7d6448 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:25.231663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5baea-727d-48c4-b58b-4c106b7d6448 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:25.232036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5baea-727d-48c4-b58b-4c106b7d6448 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:25.233496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 687/1358] 10.222.0.64 () {54 vars in 961 bytes} [Wed May 11 06:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:25.239719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5104b3-b561-4511-bf92-3684e2a7c9a5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:25.240210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5104b3-b561-4511-bf92-3684e2a7c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:25.240563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5104b3-b561-4511-bf92-3684e2a7c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:25.288773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-da5104b3-b561-4511-bf92-3684e2a7c9a5 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:25.290106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-da5104b3-b561-4511-bf92-3684e2a7c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:25.384334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 672/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Wed May 11 06:31:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:25.392687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5baea-727d-48c4-b58b-4c106b7d6448 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:25.408322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5baea-727d-48c4-b58b-4c106b7d6448 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:25.414559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:25.415291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:25.415647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:25.415989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:25.424127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:25.425764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feff9a9-c9c9-4a7e-8283-cb03c0ffa9dc service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:25.435856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 688/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:27.874413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615dfec-250f-4307-8d1a-6fe41f1488f3 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:27.874970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615dfec-250f-4307-8d1a-6fe41f1488f3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:27.874970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615dfec-250f-4307-8d1a-6fe41f1488f3 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:27.876372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 673/1361] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:27.882276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c143-c768-449a-87fd-30d3c3673863 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:27.882680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c143-c768-449a-87fd-30d3c3673863 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:27.882835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c143-c768-449a-87fd-30d3c3673863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:27.900235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cc77c143-c768-449a-87fd-30d3c3673863 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:27.901435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cc77c143-c768-449a-87fd-30d3c3673863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:27.909324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 689/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:27.953459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615dfec-250f-4307-8d1a-6fe41f1488f3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:27.967967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615dfec-250f-4307-8d1a-6fe41f1488f3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:27.973730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:27.974473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:27.974846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:27.975217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:27.983501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:27.985184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93be7d-65cf-477e-a32a-698ac7f91980 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:27.995633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 674/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:30.530363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f914d-0590-422c-98f3-e208c03109a1 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:30.530870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f914d-0590-422c-98f3-e208c03109a1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:30.530965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f914d-0590-422c-98f3-e208c03109a1 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:30.532322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 690/1364] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:30.537961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4271-410e-44d0-8893-69125005da4c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:30.538883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4271-410e-44d0-8893-69125005da4c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:30.539329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4271-410e-44d0-8893-69125005da4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:30.558001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b04e4271-410e-44d0-8893-69125005da4c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:30.559194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b04e4271-410e-44d0-8893-69125005da4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:30.570861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 675/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:30.612853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af006-7a33-4573-a06f-6c354ee50e46 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:30.613114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af006-7a33-4573-a06f-6c354ee50e46 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:30.613996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af006-7a33-4573-a06f-6c354ee50e46 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:30.615702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 691/1366] 10.222.0.64 () {54 vars in 961 bytes} [Wed May 11 06:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:30.621910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6e6f-4a3b-4b55-8641-099471d48001 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:30.622275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6e6f-4a3b-4b55-8641-099471d48001 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:30.622414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6e6f-4a3b-4b55-8641-099471d48001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:30.641241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-821f6e6f-4a3b-4b55-8641-099471d48001 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:30.645879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-821f6e6f-4a3b-4b55-8641-099471d48001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:30.666832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 676/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Wed May 11 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:30.667865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af006-7a33-4573-a06f-6c354ee50e46 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:30.682543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af006-7a33-4573-a06f-6c354ee50e46 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:30.687984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:30.688622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:30.688901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:30.689174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:30.697775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:30.699356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144431d9-b7b6-4fc2-96d2-1e1c8ef550ed service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:30.709223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 692/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:33.008249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c4ee-23f4-468f-9f07-986a61f69f6c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.008777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c4ee-23f4-468f-9f07-986a61f69f6c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.008777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c4ee-23f4-468f-9f07-986a61f69f6c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.010150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 677/1369] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:33.015580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef24e1-bde7-493b-a2ef-aa4fe8a46793 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.016018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef24e1-bde7-493b-a2ef-aa4fe8a46793 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.016121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef24e1-bde7-493b-a2ef-aa4fe8a46793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.033314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-94ef24e1-bde7-493b-a2ef-aa4fe8a46793 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:33.034613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-94ef24e1-bde7-493b-a2ef-aa4fe8a46793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:33.042716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 693/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:33.086986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c4ee-23f4-468f-9f07-986a61f69f6c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:33.101779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c4ee-23f4-468f-9f07-986a61f69f6c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:33.107189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:33.107952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.108335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.108722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.117448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:33.119111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b6c42-b05f-4714-b636-4766f5815773 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:33.128786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 678/1371] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:33.374296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7478e-feda-4382-ad3c-e7bdf859dc00 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.374602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7478e-feda-4382-ad3c-e7bdf859dc00 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.374876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7478e-feda-4382-ad3c-e7bdf859dc00 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.377603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 694/1372] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:33.383253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4727-dbed-4163-b688-ccb1a8544a5a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.383719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4727-dbed-4163-b688-ccb1a8544a5a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.384215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4727-dbed-4163-b688-ccb1a8544a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.404917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-28be4727-dbed-4163-b688-ccb1a8544a5a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:33.406437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-28be4727-dbed-4163-b688-ccb1a8544a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:33.415153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 679/1373] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:33.695136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e957a1-05e5-4d0d-ada1-aca80c8d4975 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.695684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e957a1-05e5-4d0d-ada1-aca80c8d4975 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.696186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e957a1-05e5-4d0d-ada1-aca80c8d4975 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.698682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 695/1374] 10.222.0.64 () {54 vars in 963 bytes} [Wed May 11 06:31:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:33.703722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b44ca-7d92-419b-aeef-8ebfbfa27eed None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.704009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b44ca-7d92-419b-aeef-8ebfbfa27eed None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.704281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b44ca-7d92-419b-aeef-8ebfbfa27eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.752492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-183b44ca-7d92-419b-aeef-8ebfbfa27eed None None] MFA Rules not processed for user `d48b44bd541f4b448ccd6ee0f060a011`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:33.753776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-183b44ca-7d92-419b-aeef-8ebfbfa27eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:33.812498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 680/1375] 10.222.0.64 () {58 vars in 1060 bytes} [Wed May 11 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:33.820245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e957a1-05e5-4d0d-ada1-aca80c8d4975 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:33.830724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e957a1-05e5-4d0d-ada1-aca80c8d4975 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:33.834789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:33.835447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:33.835725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:33.835992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:33.845564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:33.846984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec38bd5-aca2-49cc-82f7-e947d4f7fe1d service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:33.857753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 696/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:35.396708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395b43-973c-4cfd-9c8a-c2011770111b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:35.397302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395b43-973c-4cfd-9c8a-c2011770111b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:35.397302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395b43-973c-4cfd-9c8a-c2011770111b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:35.398680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 681/1377] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:35.406048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400b2d-b295-4b88-99a2-dcfaf0e055d3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:35.406607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400b2d-b295-4b88-99a2-dcfaf0e055d3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:35.406607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400b2d-b295-4b88-99a2-dcfaf0e055d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:35.424812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f8400b2d-b295-4b88-99a2-dcfaf0e055d3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:35.426587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f8400b2d-b295-4b88-99a2-dcfaf0e055d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:35.436975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 697/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:35.481967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395b43-973c-4cfd-9c8a-c2011770111b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:35.496787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395b43-973c-4cfd-9c8a-c2011770111b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:35.502097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:35.502747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:35.503023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:35.503344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:35.512901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:35.514525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7df59-d26b-497e-8af8-368fc1dacc4d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:35.524914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 682/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:37.811329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5ff8e-0756-4e1f-bb46-30498fe4d533 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:37.812290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5ff8e-0756-4e1f-bb46-30498fe4d533 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:37.812774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5ff8e-0756-4e1f-bb46-30498fe4d533 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:37.814616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 698/1380] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:37.820862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32e1e-c280-4770-8425-1768834ef104 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:37.821307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32e1e-c280-4770-8425-1768834ef104 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:37.821418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32e1e-c280-4770-8425-1768834ef104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:37.840445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-01c32e1e-c280-4770-8425-1768834ef104 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:37.841788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-01c32e1e-c280-4770-8425-1768834ef104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:37.849900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 683/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:37.892149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5ff8e-0756-4e1f-bb46-30498fe4d533 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:37.907115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5ff8e-0756-4e1f-bb46-30498fe4d533 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:37.912594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:37.913341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:37.913721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:37.914153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:37.922445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:37.924181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262611b7-1d01-4ef4-bdc1-166c0b19b8b3 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:37.933852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 699/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:40.179738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c379-a816-46dd-a8e9-5f21583570b7 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:40.180285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c379-a816-46dd-a8e9-5f21583570b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:40.180285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732c379-a816-46dd-a8e9-5f21583570b7 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:40.181672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 684/1383] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:31:40.187203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf10e-847b-43ee-9e0e-08d5d18a5586 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:40.187719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf10e-847b-43ee-9e0e-08d5d18a5586 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:40.187828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cf10e-847b-43ee-9e0e-08d5d18a5586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:40.206336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5e8cf10e-847b-43ee-9e0e-08d5d18a5586 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:40.207587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5e8cf10e-847b-43ee-9e0e-08d5d18a5586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:40.215567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 700/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:40.258430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732c379-a816-46dd-a8e9-5f21583570b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:40.274162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732c379-a816-46dd-a8e9-5f21583570b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:40.280278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:40.281060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:40.281363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:40.281636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:40.291644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:40.293295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48497-8e0f-4519-8aa1-d96bd27980d8 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:40.304964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 685/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:42.552451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd9e5-0608-47a3-b866-6d759873829f None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:42.552982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd9e5-0608-47a3-b866-6d759873829f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:42.553150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd9e5-0608-47a3-b866-6d759873829f None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:42.554966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 701/1386] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:42.560332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722379-6243-47da-ac21-d2efceb9e8b4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:42.560888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722379-6243-47da-ac21-d2efceb9e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:42.560888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722379-6243-47da-ac21-d2efceb9e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:42.583596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-65722379-6243-47da-ac21-d2efceb9e8b4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:42.585176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-65722379-6243-47da-ac21-d2efceb9e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:42.594859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 686/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:42.642296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebd9e5-0608-47a3-b866-6d759873829f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:42.657373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebd9e5-0608-47a3-b866-6d759873829f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:42.663596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:42.664191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:42.664469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:42.664741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:42.673345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:42.674981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a22ca-c97c-46fa-bae4-9b4f8303f273 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:42.684528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 702/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:45.014624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7797a-2ecb-4348-8f57-cd6f8dd63579 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:45.015179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7797a-2ecb-4348-8f57-cd6f8dd63579 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:45.015415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7797a-2ecb-4348-8f57-cd6f8dd63579 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:45.017202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 687/1389] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:45.022640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405cf9-e777-4ecf-b056-0d3fa85173f9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:45.023154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405cf9-e777-4ecf-b056-0d3fa85173f9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:45.023346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405cf9-e777-4ecf-b056-0d3fa85173f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:45.040852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ff405cf9-e777-4ecf-b056-0d3fa85173f9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:45.042064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ff405cf9-e777-4ecf-b056-0d3fa85173f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:45.050094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 703/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:45.096671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7797a-2ecb-4348-8f57-cd6f8dd63579 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:45.111171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7797a-2ecb-4348-8f57-cd6f8dd63579 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:45.117603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:45.118442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:45.118752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:45.119061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:45.127575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:45.130125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae2e9e-7e56-40b3-b7c0-3d881913bb4b service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:45.139042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 688/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:47.392979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3bc06-cc79-4ad9-8d80-2337e7d1d530 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:47.393564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3bc06-cc79-4ad9-8d80-2337e7d1d530 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:47.393564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3bc06-cc79-4ad9-8d80-2337e7d1d530 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:47.395483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 704/1392] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:47.400906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae565f-ddca-4179-b2a8-4c3b4e349b86 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:47.401372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae565f-ddca-4179-b2a8-4c3b4e349b86 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:47.401474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae565f-ddca-4179-b2a8-4c3b4e349b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:47.420500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7cae565f-ddca-4179-b2a8-4c3b4e349b86 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:47.421691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7cae565f-ddca-4179-b2a8-4c3b4e349b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:47.429640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 689/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:47.472618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3bc06-cc79-4ad9-8d80-2337e7d1d530 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:47.487097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3bc06-cc79-4ad9-8d80-2337e7d1d530 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:47.492677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:47.493309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:47.493595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:47.493864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:47.502058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:47.503802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbeda0f-3887-46e4-b93d-ee91e3fb3c0d service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:47.513194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 705/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:49.555832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a7-059d-431b-9d5e-703aeb3308f8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.556355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a7-059d-431b-9d5e-703aeb3308f8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.556355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0528a7-059d-431b-9d5e-703aeb3308f8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.557680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 690/1395] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:49.563062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f8ed9-70b6-412e-b374-fe9be1dc7b55 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.563617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f8ed9-70b6-412e-b374-fe9be1dc7b55 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.563617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f8ed9-70b6-412e-b374-fe9be1dc7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.585113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5a5f8ed9-70b6-412e-b374-fe9be1dc7b55 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:49.586370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5a5f8ed9-70b6-412e-b374-fe9be1dc7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:49.596982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 706/1396] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:49.653545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77df90f-8999-4656-8ebf-6bf0730b904d None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.653838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77df90f-8999-4656-8ebf-6bf0730b904d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.654118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77df90f-8999-4656-8ebf-6bf0730b904d None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.655583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 691/1397] 10.222.0.64 () {54 vars in 962 bytes} [Wed May 11 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:49.660451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1f542-58c4-4785-a445-f7043f9424fe None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.660742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1f542-58c4-4785-a445-f7043f9424fe None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.661010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1f542-58c4-4785-a445-f7043f9424fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.707797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a1e1f542-58c4-4785-a445-f7043f9424fe None None] MFA Rules not processed for user `a776f52df1c944ed9b28524b7c582e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:49.708968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a1e1f542-58c4-4785-a445-f7043f9424fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:49.765329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 707/1398] 10.222.0.64 () {58 vars in 1059 bytes} [Wed May 11 06:31:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:49.765664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39c3d3-53e1-414e-946c-0991bd29a00a None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.765870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39c3d3-53e1-414e-946c-0991bd29a00a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.766335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39c3d3-53e1-414e-946c-0991bd29a00a None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.767720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 692/1399] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:31:49.772391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39c3d3-53e1-414e-946c-0991bd29a00a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:49.772829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.773175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.773379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.782871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39c3d3-53e1-414e-946c-0991bd29a00a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:49.786834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:49.787487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.787766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.788038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.790791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:49.792014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:49.796783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:49.798191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4438d-d0f3-45fe-bfd1-23a8a4848e35 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:49.800141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 708/1400] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:49.808551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 693/1401] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:31:49.846524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:49.858910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7212e0-9dfd-430f-85bb-e1ef60ed11cf None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:49.864853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:49.865488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:49.865769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:49.866036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:49.874949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:49.876572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61981f72-2062-4764-8d0c-6795c6c3c317 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:49.887303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 709/1402] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:31:50.227487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d58-fb9c-486d-8623-9e7dbb6dc908 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:50.227794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d58-fb9c-486d-8623-9e7dbb6dc908 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:50.228068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d58-fb9c-486d-8623-9e7dbb6dc908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:50.275535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d40e5d58-fb9c-486d-8623-9e7dbb6dc908 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:50.276737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d40e5d58-fb9c-486d-8623-9e7dbb6dc908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:50.338762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 694/1403] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:31:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:50.379887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b808-13e7-467d-9d6e-dca67379ceaa None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:50.380249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b808-13e7-467d-9d6e-dca67379ceaa None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:50.380598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b808-13e7-467d-9d6e-dca67379ceaa None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:50.382111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 710/1404] 10.222.0.64 () {54 vars in 942 bytes} [Wed May 11 06:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:50.388461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c91a-e4cb-4522-a041-c92e603d46ff None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:50.388817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c91a-e4cb-4522-a041-c92e603d46ff None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:50.389157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553c91a-e4cb-4522-a041-c92e603d46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:50.439161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8553c91a-e4cb-4522-a041-c92e603d46ff None None] MFA Rules not processed for user `179b4ae6970d49be8579745634c8ec67`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:50.440371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8553c91a-e4cb-4522-a041-c92e603d46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:50.509146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 695/1405] 10.222.0.64 () {58 vars in 1039 bytes} [Wed May 11 06:31:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:31:50.518402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782b808-13e7-467d-9d6e-dca67379ceaa None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:50.531982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782b808-13e7-467d-9d6e-dca67379ceaa None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:50.537452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:50.538085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:50.538365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:50.538638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:50.546817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:50.548426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e8e5-7cd8-4f53-a83a-4888ad7e439d service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:50.556733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 711/1406] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:31:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:31:52.155898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5065b-6dd2-4af3-8682-5599aa444b63 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:52.157007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5065b-6dd2-4af3-8682-5599aa444b63 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:52.158167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5065b-6dd2-4af3-8682-5599aa444b63 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:52.160347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 696/1407] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:31:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:31:52.172401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca8ff-43a2-4c29-bec0-2347ef37c165 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:52.172401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca8ff-43a2-4c29-bec0-2347ef37c165 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:52.172401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca8ff-43a2-4c29-bec0-2347ef37c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:52.205076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3a0ca8ff-43a2-4c29-bec0-2347ef37c165 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:31:52.205076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3a0ca8ff-43a2-4c29-bec0-2347ef37c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:31:52.223428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 712/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:31:52.270721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5065b-6dd2-4af3-8682-5599aa444b63 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:31:52.288851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5065b-6dd2-4af3-8682-5599aa444b63 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:31:52.297169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:31:52.297913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:31:52.298315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:31:52.298616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:31:52.307522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:31:52.309091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a33426-fd77-4796-8205-e840cf69bc0d service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:31:52.321133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 697/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:14.028781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8bf3-dcf6-483d-87f0-88c6c4a59ecd None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:14.029384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8bf3-dcf6-483d-87f0-88c6c4a59ecd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:14.029384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8bf3-dcf6-483d-87f0-88c6c4a59ecd None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:14.030747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 713/1410] 10.222.0.64 () {54 vars in 918 bytes} [Wed May 11 06:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:14.036087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bf73-c49c-45a0-b0a6-7e9ec5f4ce7c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:14.036544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bf73-c49c-45a0-b0a6-7e9ec5f4ce7c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:14.036649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bf73-c49c-45a0-b0a6-7e9ec5f4ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:14.054547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c185bf73-c49c-45a0-b0a6-7e9ec5f4ce7c None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:14.055768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c185bf73-c49c-45a0-b0a6-7e9ec5f4ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:14.064387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 698/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Wed May 11 06:32:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:32:14.083924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383427-15db-4c69-a364-0ac2dcdae4d9 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:14.084195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383427-15db-4c69-a364-0ac2dcdae4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:14.084468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383427-15db-4c69-a364-0ac2dcdae4d9 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:14.085830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 714/1412] 10.222.0.64 () {54 vars in 918 bytes} [Wed May 11 06:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:14.090848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc78a-bd8e-4634-bf38-82420bb6ff4b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:14.091134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc78a-bd8e-4634-bf38-82420bb6ff4b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:14.091447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dc78a-bd8e-4634-bf38-82420bb6ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:14.109266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-039dc78a-bd8e-4634-bf38-82420bb6ff4b None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:14.110454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-039dc78a-bd8e-4634-bf38-82420bb6ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:14.119564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 699/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Wed May 11 06:32:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:16.801589 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ba73-3ad7-4c3e-99bf-9e58d607e71d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:16.802175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ba73-3ad7-4c3e-99bf-9e58d607e71d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:16.802175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ba73-3ad7-4c3e-99bf-9e58d607e71d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:16.803472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:16.808616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa6d1-3ad7-478f-a056-38e338b1618b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:16.809061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa6d1-3ad7-478f-a056-38e338b1618b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:16.809174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa6d1-3ad7-478f-a056-38e338b1618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:16.827033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2d0aa6d1-3ad7-478f-a056-38e338b1618b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:16.828259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d0aa6d1-3ad7-478f-a056-38e338b1618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:16.836450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:16.876695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ba73-3ad7-4c3e-99bf-9e58d607e71d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:16.890855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ba73-3ad7-4c3e-99bf-9e58d607e71d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:16.896716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:16.897333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:16.897609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:16.897878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:16.905580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:16.907134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642c8d8-bb59-424d-99fc-1bbba4969396 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:16.916083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 716/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:17.897463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643c46-52d4-40db-a36b-03a0a0e1708b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:17.898053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643c46-52d4-40db-a36b-03a0a0e1708b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:17.898053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643c46-52d4-40db-a36b-03a0a0e1708b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:17.899389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:17.904264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0e48-2954-4bec-9d97-5447ad576951 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:17.904654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0e48-2954-4bec-9d97-5447ad576951 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:17.904837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0e48-2954-4bec-9d97-5447ad576951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:17.922573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c81b0e48-2954-4bec-9d97-5447ad576951 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:17.923780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c81b0e48-2954-4bec-9d97-5447ad576951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:17.931245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:18.083314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a643c46-52d4-40db-a36b-03a0a0e1708b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:18.101340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a643c46-52d4-40db-a36b-03a0a0e1708b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:18.111061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:18.111833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:18.112110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:18.112388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:18.124896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:18.126636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fa1f6-f4cb-4841-bd76-f2155fc9f6db service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:18.136056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 702/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:19.072653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54669-75d6-4728-b6e6-d919e66cbc55 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:19.073218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54669-75d6-4728-b6e6-d919e66cbc55 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:19.073218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54669-75d6-4728-b6e6-d919e66cbc55 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:19.074607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:19.079475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17c12-ded2-41a7-a57d-9264178cb7ae None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:19.079900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17c12-ded2-41a7-a57d-9264178cb7ae None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:19.080033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17c12-ded2-41a7-a57d-9264178cb7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:19.098252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-87b17c12-ded2-41a7-a57d-9264178cb7ae None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:19.099470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-87b17c12-ded2-41a7-a57d-9264178cb7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:19.107079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:32:19.253642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54669-75d6-4728-b6e6-d919e66cbc55 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:19.267575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54669-75d6-4728-b6e6-d919e66cbc55 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:19.273133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:19.273775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:19.274058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:19.274338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:19.282395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:19.284004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4144-cf88-4d99-9cf9-e4a9a2c38dd9 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:19.293688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 719/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:20.215493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896352-704a-47ba-bd31-63811f512441 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:20.216040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896352-704a-47ba-bd31-63811f512441 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:20.216040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896352-704a-47ba-bd31-63811f512441 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:20.217418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:20.222347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542502fd-57e5-402e-89d9-b696fd09f117 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:20.222790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542502fd-57e5-402e-89d9-b696fd09f117 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:20.222898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542502fd-57e5-402e-89d9-b696fd09f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:20.240700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-542502fd-57e5-402e-89d9-b696fd09f117 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:20.241890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-542502fd-57e5-402e-89d9-b696fd09f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:20.249556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:20.406896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f896352-704a-47ba-bd31-63811f512441 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:20.420580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f896352-704a-47ba-bd31-63811f512441 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:20.426319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:20.426956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:20.427232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:20.427544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:20.435942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:20.437566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f5bc-9c5f-4baa-9024-08ec44c88e3e service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:20.448118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 705/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:21.373367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5450e0-34b8-4868-b0e3-211830f640bc None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:21.373835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5450e0-34b8-4868-b0e3-211830f640bc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:21.373931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5450e0-34b8-4868-b0e3-211830f640bc None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:21.375308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:21.380759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19388-806f-458b-ae27-1fac5b965167 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:21.381159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19388-806f-458b-ae27-1fac5b965167 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:21.381302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19388-806f-458b-ae27-1fac5b965167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:21.400268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4fe19388-806f-458b-ae27-1fac5b965167 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:21.401469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4fe19388-806f-458b-ae27-1fac5b965167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:21.409172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:21.558488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5450e0-34b8-4868-b0e3-211830f640bc None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:21.573172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5450e0-34b8-4868-b0e3-211830f640bc None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:21.578335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:21.578963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:21.579242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:21.579537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:21.588163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:21.589731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002953b-4955-4df9-8f7d-79371a734e91 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:21.599363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 722/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:22.499822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90350d-66ef-4c18-8764-63920fac1106 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:22.500343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90350d-66ef-4c18-8764-63920fac1106 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:22.500343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90350d-66ef-4c18-8764-63920fac1106 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:22.501739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:22.506634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ef1e-db08-4cf9-8d0d-c1304dacb76a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:22.507072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ef1e-db08-4cf9-8d0d-c1304dacb76a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:22.507168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ef1e-db08-4cf9-8d0d-c1304dacb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:22.524746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b423ef1e-db08-4cf9-8d0d-c1304dacb76a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:22.525911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b423ef1e-db08-4cf9-8d0d-c1304dacb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:22.533451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:22.681933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90350d-66ef-4c18-8764-63920fac1106 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:22.695891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90350d-66ef-4c18-8764-63920fac1106 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:22.701238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:22.701868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:22.702147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:22.702419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:22.710722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:22.712313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e84c0-e08f-4773-8d75-203d3f663cba service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:22.721323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 708/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:23.578547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a55c-43d0-4de0-9aff-5c021598b91d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:23.579057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a55c-43d0-4de0-9aff-5c021598b91d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:23.579057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44a55c-43d0-4de0-9aff-5c021598b91d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:23.580443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:23.585256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164bb0e-504a-4efe-bec9-3ac29fd20608 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:23.585675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164bb0e-504a-4efe-bec9-3ac29fd20608 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:23.585808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164bb0e-504a-4efe-bec9-3ac29fd20608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:23.603791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0164bb0e-504a-4efe-bec9-3ac29fd20608 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:23.604969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0164bb0e-504a-4efe-bec9-3ac29fd20608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:23.612657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:23.760935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44a55c-43d0-4de0-9aff-5c021598b91d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:23.774797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44a55c-43d0-4de0-9aff-5c021598b91d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:23.780069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:23.780693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:23.780974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:23.781263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:23.789571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:23.791135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e92a86-fccc-42e9-9878-0db6ec8b4a7e service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:23.800151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 725/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:24.665061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7b53-30cf-41c1-a1b4-ac073c4420fd None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:24.665651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7b53-30cf-41c1-a1b4-ac073c4420fd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:24.665651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7b53-30cf-41c1-a1b4-ac073c4420fd None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:24.666954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:24.671991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e8bc-5b6c-4e7a-be86-739dbe8c4b5c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:24.672391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e8bc-5b6c-4e7a-be86-739dbe8c4b5c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:24.672540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e8bc-5b6c-4e7a-be86-739dbe8c4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:24.690344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-64e3e8bc-5b6c-4e7a-be86-739dbe8c4b5c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:24.692042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-64e3e8bc-5b6c-4e7a-be86-739dbe8c4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:24.699930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:24.857578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7b53-30cf-41c1-a1b4-ac073c4420fd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:24.871891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7b53-30cf-41c1-a1b4-ac073c4420fd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:24.877570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:24.878203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:24.879097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:24.879439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:24.887429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:24.888993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefd392-038d-4572-98f7-b92d8ecb5341 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:24.898284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 711/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:25.766036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68e69-d9c3-4f17-8e96-f9f8856f47b2 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:25.766568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68e69-d9c3-4f17-8e96-f9f8856f47b2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:25.766568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68e69-d9c3-4f17-8e96-f9f8856f47b2 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:25.767997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:25.773590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33f63-cd62-4be4-bd9d-255bb3e40674 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:25.774318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33f63-cd62-4be4-bd9d-255bb3e40674 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:25.774600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33f63-cd62-4be4-bd9d-255bb3e40674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:25.792681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-53d33f63-cd62-4be4-bd9d-255bb3e40674 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:25.793853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-53d33f63-cd62-4be4-bd9d-255bb3e40674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:25.801400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:25.948096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68e69-d9c3-4f17-8e96-f9f8856f47b2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:25.962674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68e69-d9c3-4f17-8e96-f9f8856f47b2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:25.968129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:25.968758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:25.969039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:25.969316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:25.977225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:25.978811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18d31-a29b-4033-a027-8d92273776e1 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:25.988039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 728/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:28.066020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5176e4-5503-48aa-8f4b-70443eddda1e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:28.066556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5176e4-5503-48aa-8f4b-70443eddda1e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:28.066556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5176e4-5503-48aa-8f4b-70443eddda1e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:28.067947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:28.073372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb726-b47e-4004-aca8-2c47d93cb20e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:28.073775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb726-b47e-4004-aca8-2c47d93cb20e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:28.073928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb726-b47e-4004-aca8-2c47d93cb20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:28.091782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-68bcb726-b47e-4004-aca8-2c47d93cb20e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:28.092967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-68bcb726-b47e-4004-aca8-2c47d93cb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:28.101253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:28.138228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5176e4-5503-48aa-8f4b-70443eddda1e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:28.148646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5176e4-5503-48aa-8f4b-70443eddda1e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:28.152072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:28.152692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:28.152966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:28.153236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:28.162651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:28.164408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0624-2c63-4dc2-896c-73bf5c1f64bf service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:28.174591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 714/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:30.585396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425abf52-2071-47a0-99ff-1984adfb76a0 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:30.585922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425abf52-2071-47a0-99ff-1984adfb76a0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:30.585922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425abf52-2071-47a0-99ff-1984adfb76a0 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:30.587326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:30.592623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741fc8-7136-4765-a1a6-4db8a63297f8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:30.593041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741fc8-7136-4765-a1a6-4db8a63297f8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:30.593188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741fc8-7136-4765-a1a6-4db8a63297f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:30.610223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-63741fc8-7136-4765-a1a6-4db8a63297f8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:30.611451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-63741fc8-7136-4765-a1a6-4db8a63297f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:30.619236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:32:30.656653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425abf52-2071-47a0-99ff-1984adfb76a0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:30.667027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425abf52-2071-47a0-99ff-1984adfb76a0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:30.670501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:30.671126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:30.671443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:30.671723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:30.681019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:30.682389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf261a3b-640a-455e-9846-4318a5d997ab service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:30.692053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 731/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:33.186938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f19b-50c0-4c7f-bbd1-674e4913dc47 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:33.187509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f19b-50c0-4c7f-bbd1-674e4913dc47 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:33.187509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f19b-50c0-4c7f-bbd1-674e4913dc47 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:33.188934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:33.195233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad60a-3457-4a71-be14-0a65b8686057 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:33.195674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad60a-3457-4a71-be14-0a65b8686057 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:33.195816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad60a-3457-4a71-be14-0a65b8686057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:33.212731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-05fad60a-3457-4a71-be14-0a65b8686057 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:33.213890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-05fad60a-3457-4a71-be14-0a65b8686057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:33.221433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:33.259004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f19b-50c0-4c7f-bbd1-674e4913dc47 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:33.269674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f19b-50c0-4c7f-bbd1-674e4913dc47 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:33.273171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:33.273798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:33.274072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:33.274336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:33.282891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:33.284353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548c7b8-4c52-4fca-bcce-86633c780794 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:33.293830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 717/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:35.613159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cbe1-a900-4489-932d-acedb338e385 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:35.613732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cbe1-a900-4489-932d-acedb338e385 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:35.613732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cbe1-a900-4489-932d-acedb338e385 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:35.615022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:35.620538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c601-dda1-401d-a12c-5676f3da0f2d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:35.620972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c601-dda1-401d-a12c-5676f3da0f2d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:35.621078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c601-dda1-401d-a12c-5676f3da0f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:35.639074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5201c601-dda1-401d-a12c-5676f3da0f2d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:35.640315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5201c601-dda1-401d-a12c-5676f3da0f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:35.648521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:35.685689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cbe1-a900-4489-932d-acedb338e385 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:35.696804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cbe1-a900-4489-932d-acedb338e385 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:35.700284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:35.700909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:35.701189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:35.701483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:35.710611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:35.712053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e4b2b-b35b-4f68-b756-04f6200ff246 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:35.721110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 734/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:37.989351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19c71-3e70-4dd1-b57e-02e565115de8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:37.989953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19c71-3e70-4dd1-b57e-02e565115de8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:37.989953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19c71-3e70-4dd1-b57e-02e565115de8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:37.991260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:37.996638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2fc1-a6f4-4d54-8367-0fd0f363925b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:37.997037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2fc1-a6f4-4d54-8367-0fd0f363925b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:37.997190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2fc1-a6f4-4d54-8367-0fd0f363925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:38.014804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-675a2fc1-a6f4-4d54-8367-0fd0f363925b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:38.016010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-675a2fc1-a6f4-4d54-8367-0fd0f363925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:38.024235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:38.060746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19c71-3e70-4dd1-b57e-02e565115de8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:38.071821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19c71-3e70-4dd1-b57e-02e565115de8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:38.075216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:38.075874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:38.076151 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:38.076421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:38.085552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:38.086939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663e60-d046-4517-af1e-ba60f1b60ceb service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:38.095938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 720/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:40.362399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5a9ab-0543-44ca-93b2-b7e0b56b8ac2 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:40.363642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5a9ab-0543-44ca-93b2-b7e0b56b8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:40.363642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5a9ab-0543-44ca-93b2-b7e0b56b8ac2 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:40.364919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:40.370314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222beac-3500-42b8-adee-f0e9e8fb1aa3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:40.370727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222beac-3500-42b8-adee-f0e9e8fb1aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:40.370872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222beac-3500-42b8-adee-f0e9e8fb1aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:40.388153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5222beac-3500-42b8-adee-f0e9e8fb1aa3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:40.389343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5222beac-3500-42b8-adee-f0e9e8fb1aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:40.397510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:40.435760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5a9ab-0543-44ca-93b2-b7e0b56b8ac2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:40.446272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5a9ab-0543-44ca-93b2-b7e0b56b8ac2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:40.449733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:40.450361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:40.450639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:40.450907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:40.459874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:40.461289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c90d-7506-40ee-b376-d7e98885ecf6 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:40.470212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 737/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:42.715885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da110-1ad4-4801-b5c0-d533d3ed6abf None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:42.716415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da110-1ad4-4801-b5c0-d533d3ed6abf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:42.716415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da110-1ad4-4801-b5c0-d533d3ed6abf None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:42.717740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:42.723775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845c0f-ee4a-4d92-89a1-952f6fcb67ff None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:42.724220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845c0f-ee4a-4d92-89a1-952f6fcb67ff None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:42.724334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845c0f-ee4a-4d92-89a1-952f6fcb67ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:42.741346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-81845c0f-ee4a-4d92-89a1-952f6fcb67ff None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:42.742519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-81845c0f-ee4a-4d92-89a1-952f6fcb67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:42.750140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:42.787005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da110-1ad4-4801-b5c0-d533d3ed6abf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:42.797459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da110-1ad4-4801-b5c0-d533d3ed6abf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:42.800970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:42.801598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:42.801880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:42.802156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:42.810700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:42.812137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3cf44-1b2b-46f8-99d8-47c49918a540 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:42.821534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 723/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:45.057774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b141f-1832-447a-93f4-a1bc5cdd982d None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:45.058344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b141f-1832-447a-93f4-a1bc5cdd982d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:45.058344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b141f-1832-447a-93f4-a1bc5cdd982d None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:45.059706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:45.065109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90463ff-934b-42f1-8922-7807c2d24c87 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:45.065561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90463ff-934b-42f1-8922-7807c2d24c87 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:45.065671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90463ff-934b-42f1-8922-7807c2d24c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:45.083547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f90463ff-934b-42f1-8922-7807c2d24c87 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:45.084736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f90463ff-934b-42f1-8922-7807c2d24c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:45.092357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:45.128565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b141f-1832-447a-93f4-a1bc5cdd982d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:45.138990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b141f-1832-447a-93f4-a1bc5cdd982d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:45.142443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:45.143066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:45.143393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:45.144166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:45.152697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:45.154114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ed88f-06cd-4f58-82d0-37e43bb8b80b service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:45.163986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 740/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:47.363147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3533-cc9b-4fd6-b2bd-a4ec0263fd7c None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:47.363635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3533-cc9b-4fd6-b2bd-a4ec0263fd7c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:47.363741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f3533-cc9b-4fd6-b2bd-a4ec0263fd7c None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:47.365136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:47.370402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d86b-a79e-4097-bc09-1c5ba109aa0d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:47.370845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d86b-a79e-4097-bc09-1c5ba109aa0d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:47.370988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d86b-a79e-4097-bc09-1c5ba109aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:47.388571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4466d86b-a79e-4097-bc09-1c5ba109aa0d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:47.389764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4466d86b-a79e-4097-bc09-1c5ba109aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:47.397892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:47.433428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3533-cc9b-4fd6-b2bd-a4ec0263fd7c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:47.443976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f3533-cc9b-4fd6-b2bd-a4ec0263fd7c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:47.447735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:47.448367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:47.448647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:47.448928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:47.457993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:47.459441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2db759-4bd4-4fe0-8c0b-53a51a202f8d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:47.468535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 726/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:32:49.678436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c8c2-3bbf-4930-a438-4a6ef7e559cb None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:49.678994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c8c2-3bbf-4930-a438-4a6ef7e559cb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:49.678994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c8c2-3bbf-4930-a438-4a6ef7e559cb None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:49.680466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:32:49.685817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510b9-8800-4359-8007-23ddc5603b81 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:49.686224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510b9-8800-4359-8007-23ddc5603b81 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:49.686384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738510b9-8800-4359-8007-23ddc5603b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:49.703728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-738510b9-8800-4359-8007-23ddc5603b81 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:32:49.704897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-738510b9-8800-4359-8007-23ddc5603b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:32:49.713206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:32:49.748619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c8c2-3bbf-4930-a438-4a6ef7e559cb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:32:49.758899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c8c2-3bbf-4930-a438-4a6ef7e559cb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:32:49.762351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:32:49.762984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:32:49.763283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:32:49.763556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:32:49.773015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:32:49.774432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463893-9ed5-49bc-919b-ac5b5a966d9f service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:32:49.783639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 743/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:33:22.787360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5600ae-5768-4929-815b-c23f286b8849 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:22.787913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5600ae-5768-4929-815b-c23f286b8849 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:22.787913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5600ae-5768-4929-815b-c23f286b8849 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:22.789214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 728/1471] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:22.794151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858543-6db3-45aa-a9fb-084caccbd909 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:22.794550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858543-6db3-45aa-a9fb-084caccbd909 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:22.794695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858543-6db3-45aa-a9fb-084caccbd909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:22.812177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6b858543-6db3-45aa-a9fb-084caccbd909 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:22.813343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6b858543-6db3-45aa-a9fb-084caccbd909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:22.821057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 744/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:22.866696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca32-b474-4fae-acd7-fb2adde394ce None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:22.866985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca32-b474-4fae-acd7-fb2adde394ce None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:22.867289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffca32-b474-4fae-acd7-fb2adde394ce None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:22.868650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 729/1473] 10.222.0.64 () {54 vars in 962 bytes} [Wed May 11 06:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:22.873356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42140d-eefd-4339-a39c-6039e5fd4b20 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:22.873630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42140d-eefd-4339-a39c-6039e5fd4b20 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:22.873901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42140d-eefd-4339-a39c-6039e5fd4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:22.890935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bb42140d-eefd-4339-a39c-6039e5fd4b20 None None] MFA Rules not processed for user `a776f52df1c944ed9b28524b7c582e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:22.892112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bb42140d-eefd-4339-a39c-6039e5fd4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:22.898380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 745/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Wed May 11 06:33:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:33:22.905323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffca32-b474-4fae-acd7-fb2adde394ce None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:22.916136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffca32-b474-4fae-acd7-fb2adde394ce None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:22.919576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:22.920192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:22.920470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:22.920741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:22.929941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:22.931373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdea4bf-d70a-4fa6-8776-bae76f3e6af9 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:22.940401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 730/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:33:25.223679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19eac4-f38e-413a-964d-e2d2e3b832cd None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:25.224266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19eac4-f38e-413a-964d-e2d2e3b832cd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:25.224266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19eac4-f38e-413a-964d-e2d2e3b832cd None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:25.225568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 746/1476] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:25.230659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17d1-470c-4dd4-8491-eb618b842c0a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:25.231106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17d1-470c-4dd4-8491-eb618b842c0a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:25.231210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e17d1-470c-4dd4-8491-eb618b842c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:25.248816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c63e17d1-470c-4dd4-8491-eb618b842c0a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:25.249979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c63e17d1-470c-4dd4-8491-eb618b842c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:25.257841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 731/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:25.279651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19eac4-f38e-413a-964d-e2d2e3b832cd None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:25.292238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19eac4-f38e-413a-964d-e2d2e3b832cd None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:25.296498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:25.297121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:25.297396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:25.297664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:25.298378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:25.300778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:33:25.300778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:33:25.300778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:33:25.301892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c439c-b478-41ae-aa76-7a64b1eb23a4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:25.320343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 747/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Wed May 11 06:33:25 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:33:27.551397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f690e19-89f5-4e5a-9c97-f5a02a88a3eb None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:27.551956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f690e19-89f5-4e5a-9c97-f5a02a88a3eb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:27.551956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f690e19-89f5-4e5a-9c97-f5a02a88a3eb None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:27.553347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 732/1479] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:27.558422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151e2a-c600-4dc8-8d0e-cf2b0823ac78 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:27.558832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151e2a-c600-4dc8-8d0e-cf2b0823ac78 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:27.558966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151e2a-c600-4dc8-8d0e-cf2b0823ac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:27.577266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fa151e2a-c600-4dc8-8d0e-cf2b0823ac78 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:27.578435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fa151e2a-c600-4dc8-8d0e-cf2b0823ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:27.586489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 748/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:27.626809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f690e19-89f5-4e5a-9c97-f5a02a88a3eb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:27.641007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f690e19-89f5-4e5a-9c97-f5a02a88a3eb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:27.647086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:27.647773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:27.648054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:27.648326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:27.656459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:27.658008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff641a-156b-4039-92f4-01af7bc8f827 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:27.667079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 733/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:33:30.024076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906848-1e61-4b37-aa6b-d6116a049658 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:30.024660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906848-1e61-4b37-aa6b-d6116a049658 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:30.024660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906848-1e61-4b37-aa6b-d6116a049658 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:30.025978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 749/1482] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:30.031094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489b59-fecf-41d0-9d93-a7bef784ae26 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:30.031510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489b59-fecf-41d0-9d93-a7bef784ae26 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:30.031716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489b59-fecf-41d0-9d93-a7bef784ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:30.048917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ee489b59-fecf-41d0-9d93-a7bef784ae26 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:30.050111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee489b59-fecf-41d0-9d93-a7bef784ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:30.057872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 734/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:30.093822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906848-1e61-4b37-aa6b-d6116a049658 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:30.104325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906848-1e61-4b37-aa6b-d6116a049658 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:30.107814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:30.108436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:30.108714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:30.108986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:30.117484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:30.118900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819edde-1e79-4c01-8214-81386595ddab service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:30.128442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 750/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:33:32.366136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014afed-da2e-4d07-b900-6a7c45887ae8 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:32.366700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014afed-da2e-4d07-b900-6a7c45887ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:32.366700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014afed-da2e-4d07-b900-6a7c45887ae8 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:32.368062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 735/1485] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:32.373111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7a48-1f8c-4afc-a93e-5773710c1870 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:32.373510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7a48-1f8c-4afc-a93e-5773710c1870 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:32.373653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7a48-1f8c-4afc-a93e-5773710c1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:32.390522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-444f7a48-1f8c-4afc-a93e-5773710c1870 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:32.391720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-444f7a48-1f8c-4afc-a93e-5773710c1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:32.399205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 751/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:32.435989 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014afed-da2e-4d07-b900-6a7c45887ae8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:32.446786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014afed-da2e-4d07-b900-6a7c45887ae8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:32.450336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:32.450973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:32.451255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:32.451558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:32.460280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:32.461683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911adce-61e7-4cae-874a-d04d53ce002b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:32.470744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 736/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:33:34.822395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b58a-c73b-4b7b-a93d-864b8a28525a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:34.822905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b58a-c73b-4b7b-a93d-864b8a28525a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:34.822905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b58a-c73b-4b7b-a93d-864b8a28525a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:34.824243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 752/1488] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:34.829486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f0f0-ca82-4aea-a5f8-50b1bc52dd5d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:34.829983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f0f0-ca82-4aea-a5f8-50b1bc52dd5d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:34.829983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f0f0-ca82-4aea-a5f8-50b1bc52dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:34.848515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8e18f0f0-ca82-4aea-a5f8-50b1bc52dd5d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:34.849693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e18f0f0-ca82-4aea-a5f8-50b1bc52dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:34.857272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 737/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:33:34.897201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b58a-c73b-4b7b-a93d-864b8a28525a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:34.907491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b58a-c73b-4b7b-a93d-864b8a28525a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:34.911549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:34.912168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:34.912443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:34.912712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:34.921277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:34.922710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6bce9-4fde-4e63-bfcc-030124442440 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:34.932413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 753/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:33:37.332477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4cbc-1160-408f-8dbd-52dfd0dcb0e2 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:37.333080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4cbc-1160-408f-8dbd-52dfd0dcb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:37.333080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4cbc-1160-408f-8dbd-52dfd0dcb0e2 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:37.334436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 738/1491] 10.222.0.64 () {54 vars in 926 bytes} [Wed May 11 06:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:33:37.339710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d67c-5b39-4a65-945a-ee8a1be78f7c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:37.340144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d67c-5b39-4a65-945a-ee8a1be78f7c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:37.340241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d67c-5b39-4a65-945a-ee8a1be78f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:37.357250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f126d67c-5b39-4a65-945a-ee8a1be78f7c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:33:37.358409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f126d67c-5b39-4a65-945a-ee8a1be78f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:33:37.366466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 754/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Wed May 11 06:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:33:37.404339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4cbc-1160-408f-8dbd-52dfd0dcb0e2 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:33:37.414925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4cbc-1160-408f-8dbd-52dfd0dcb0e2 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:33:37.418490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:33:37.419120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:33:37.419419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:33:37.419689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:33:37.428825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:33:37.430682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449b13b-57f4-40e6-889d-1e0fbbbe9f3c service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:33:37.439350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 739/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:35:04.048355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.048966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.049067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.066882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:35:04.068099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:04.076412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 755/1494] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:35:04.086140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.086631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.086755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.104644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:35:04.105810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:04.113391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 740/1495] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:35:04.117964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.127340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac8140-beab-4053-b0ee-f63062db2c17 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.131723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.132367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.132643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.132915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.133630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:35:04.133934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.134942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.134942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:35:04.134942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:35:04.135870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.147497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 756/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:35:04.155312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.164673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46cb9b-439c-45f8-97ef-1d39862e3c4e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.169150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.169811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.170087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.170355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.171035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.172847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.172847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:35:04.172847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:35:04.174039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.209905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 741/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:35:04.214139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.224329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b7341-4c00-473f-bf3c-bd38cceb57a9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.277765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.278422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.278701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.278971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.279689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.280688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.280688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:35:04.280688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:35:04.282457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.301317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 757/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:35:04.305301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.315029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d078-8398-4f5d-b1c7-1d1ba9d99d4c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.319418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.320067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.320341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.320609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.321572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.322562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.322562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:35:04.322562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:35:04.323456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.336094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 742/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:35:04.339892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.350075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55397-1a01-49ad-86d0-42385d4934e7 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.354512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.355145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.355453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.355726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.356444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.357429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.357429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:35:04.357429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:35:04.358283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913aef5-218f-40cd-bc6a-96be757ff4fc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.370957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 758/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:35:04.374801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.384189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688392-429e-4dae-bce1-2272acdf8088 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.388527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.389377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.389649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.389920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] PATH_INFO: `/v3/projects/d48e2caf66284b08a7e16ec8a551041f/users/767b218b9d81407280365b8e771809c1/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.404386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48e2caf66284b08a7e16ec8a551041f, user_id=767b218b9d81407280365b8e771809c1, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.405393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.405393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:35:04.405393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:35:04.407942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c039c-cc81-4ee7-b080-f9bf2f986201 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.420221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 743/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:35:04 2022] PUT /identity/v3/projects/d48e2caf66284b08a7e16ec8a551041f/users/767b218b9d81407280365b8e771809c1/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:35:04.431345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fb9-4f9c-4e2e-8aed-8ce8af5d2f7f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.431585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fb9-4f9c-4e2e-8aed-8ce8af5d2f7f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.431854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fb9-4f9c-4e2e-8aed-8ce8af5d2f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.457426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f27a1fb9-4f9c-4e2e-8aed-8ce8af5d2f7f None None] MFA Rules not processed for user `767b218b9d81407280365b8e771809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:35:04.458602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f27a1fb9-4f9c-4e2e-8aed-8ce8af5d2f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:04.524574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 759/1502] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:35:04.537689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66df9-b67c-44bb-bfde-45f28b063f1e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.537978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66df9-b67c-44bb-bfde-45f28b063f1e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.538257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66df9-b67c-44bb-bfde-45f28b063f1e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.539753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 744/1503] 10.222.0.64 () {54 vars in 963 bytes} [Wed May 11 06:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:35:04.544563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdef8-c800-4a27-84e6-637ee747ab12 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.544847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdef8-c800-4a27-84e6-637ee747ab12 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.545116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdef8-c800-4a27-84e6-637ee747ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.563832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-367bdef8-c800-4a27-84e6-637ee747ab12 None None] MFA Rules not processed for user `d48b44bd541f4b448ccd6ee0f060a011`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:35:04.565145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-367bdef8-c800-4a27-84e6-637ee747ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:04.612986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 760/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:35:04.620634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66df9-b67c-44bb-bfde-45f28b063f1e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.631395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66df9-b67c-44bb-bfde-45f28b063f1e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.634829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.635488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.635770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.636043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.644469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.645859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.654535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 745/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:35:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:35:04.695644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f325b-b6cb-4806-8898-f3f72012a6bf None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.695953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f325b-b6cb-4806-8898-f3f72012a6bf None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.696511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f325b-b6cb-4806-8898-f3f72012a6bf None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.697814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 761/1506] 10.222.0.64 () {52 vars in 829 bytes} [Wed May 11 06:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:35:04.701370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.765310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440209c-d0a3-46d6-b9b8-5fa633143a4a service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:04.769903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:04.770762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.771039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.771335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] PATH_INFO: `/v3/users/767b218b9d81407280365b8e771809c1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.772501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767b218b9d81407280365b8e771809c1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:04.773494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:04.773494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:35:04.773494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:35:04.774676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:04.836825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767b218b9d81407280365b8e771809c1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:04.837525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767b218b9d81407280365b8e771809c1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:04.858185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767b218b9d81407280365b8e771809c1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:04.871174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767b218b9d81407280365b8e771809c1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:04.871931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767b218b9d81407280365b8e771809c1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:04.886469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 746/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:35:04 2022] DELETE /identity/v3/users/767b218b9d81407280365b8e771809c1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:35:04.890935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:04.891824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:04.892084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:04.909952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:35:04.911138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:04.966037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 762/1508] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:35:04.976247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:04.977658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:05.031159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929228-cd11-431d-9dc7-d2c5dfaf6df8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:05.035248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:05.035907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:05.036184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:05.036464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:05.044940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:05.046346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2133f-d687-473d-8f8b-fff88bc9acb9 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:05.055416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 747/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:35:05.372411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:35:05.374059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:35:05.386079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f639-2443-4db2-bb79-4357d925aeb0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:35:05.392395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:35:05.393553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:35:05.393833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:35:05.394101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] PATH_INFO: `/v3/projects/d48e2caf66284b08a7e16ec8a551041f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:35:05.395319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48e2caf66284b08a7e16ec8a551041f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:35:05.396342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:35:05.396342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:35:05.396342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:35:05.398028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:35:05.458658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48e2caf66284b08a7e16ec8a551041f', 'request_id': 'req-bad0f35c-7d83-4d99-89de-5836cc1d8587'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:05.464413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48e2caf66284b08a7e16ec8a551041f', 'request_id': 'req-bad0f35c-7d83-4d99-89de-5836cc1d8587'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:05.477292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48e2caf66284b08a7e16ec8a551041f', 'request_id': 'req-bad0f35c-7d83-4d99-89de-5836cc1d8587'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:05.492154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] The token cache is being invalidate because project d48e2caf66284b08a7e16ec8a551041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:35:05.492437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:05.493060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bad0f35c-7d83-4d99-89de-5836cc1d8587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:35:05.494697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 763/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:35:05 2022] DELETE /identity/v3/projects/d48e2caf66284b08a7e16ec8a551041f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:36:49.021746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:49.022357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:49.022357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:49.023712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:36:49.028587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294581-596a-4868-90c1-de6113c761ce None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:49.029031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294581-596a-4868-90c1-de6113c761ce None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:49.029153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294581-596a-4868-90c1-de6113c761ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:49.047420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6a294581-596a-4868-90c1-de6113c761ce None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:36:49.048611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6a294581-596a-4868-90c1-de6113c761ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:36:49.105367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:36:49.270493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:36:49.272270 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:36:49.343241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5385-86f4-4f27-acd4-0f5f06eeaf58 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:36:49.348588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:36:49.349227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:49.349510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:49.349784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:49.357523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:36:49.359637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab501f89-67b3-4e7a-a47e-fd586135410f service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:36:49.368583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 749/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:36:50.267322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db26b-6798-4090-99f5-faa5d6c3f727 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:50.267887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db26b-6798-4090-99f5-faa5d6c3f727 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:50.267887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db26b-6798-4090-99f5-faa5d6c3f727 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:50.269271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:36:50.274268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce800-678c-4cc9-9545-3c547ebc02be None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:50.274658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce800-678c-4cc9-9545-3c547ebc02be None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:50.274820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce800-678c-4cc9-9545-3c547ebc02be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:50.292619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cc1ce800-678c-4cc9-9545-3c547ebc02be None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:36:50.293790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cc1ce800-678c-4cc9-9545-3c547ebc02be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:36:50.301389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:36:50.454039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db26b-6798-4090-99f5-faa5d6c3f727 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:36:50.468192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db26b-6798-4090-99f5-faa5d6c3f727 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:36:50.473553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:36:50.474185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:50.474468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:50.474744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:50.482636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:36:50.484262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454121d-12f3-4db1-9918-88c8ede2d805 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:36:50.493324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 766/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:36:53.099333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc014b-724d-47d9-b6bc-5ab0933f54cf None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:53.099890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc014b-724d-47d9-b6bc-5ab0933f54cf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:53.099890 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc014b-724d-47d9-b6bc-5ab0933f54cf None None] PATH_INFO: `/v3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:53.101186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 751/1517] 10.222.0.70 () {54 vars in 925 bytes} [Wed May 11 06:36:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:36:53.125083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224141-7ffb-4a78-96ff-3c240dea04b8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:36:53.125532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224141-7ffb-4a78-96ff-3c240dea04b8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:36:53.125736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e224141-7ffb-4a78-96ff-3c240dea04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:36:53.143776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5e224141-7ffb-4a78-96ff-3c240dea04b8 None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:36:53.144972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5e224141-7ffb-4a78-96ff-3c240dea04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:36:53.204754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 767/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 11 06:36:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:01.799357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591d7f-0893-47e4-9de8-cc278a10486e None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:01.799914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591d7f-0893-47e4-9de8-cc278a10486e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:01.799914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591d7f-0893-47e4-9de8-cc278a10486e None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:01.801255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:01.806086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be86e-1ead-4a9c-96ee-9026fc3520b2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:01.806505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be86e-1ead-4a9c-96ee-9026fc3520b2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:01.806645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be86e-1ead-4a9c-96ee-9026fc3520b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:01.824565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c99be86e-1ead-4a9c-96ee-9026fc3520b2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:01.825752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c99be86e-1ead-4a9c-96ee-9026fc3520b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:01.834122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:01.992776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591d7f-0893-47e4-9de8-cc278a10486e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:02.007083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591d7f-0893-47e4-9de8-cc278a10486e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:02.016534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:02.017169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:02.017446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:02.017721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:02.025787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:02.027393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5e743-24a4-40bb-8a8f-22d9a3053619 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:02.036999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 753/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:37:02.927857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4eb6-d6cc-4f01-b7f7-e17292f1e576 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:02.928416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4eb6-d6cc-4f01-b7f7-e17292f1e576 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:02.928416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4eb6-d6cc-4f01-b7f7-e17292f1e576 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:02.929776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:02.934825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6feb-e46b-4191-abc2-b6465157de90 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:02.935250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6feb-e46b-4191-abc2-b6465157de90 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:02.935412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6feb-e46b-4191-abc2-b6465157de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:02.954056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7fad6feb-e46b-4191-abc2-b6465157de90 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:02.955227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7fad6feb-e46b-4191-abc2-b6465157de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:02.962867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:03.113384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4eb6-d6cc-4f01-b7f7-e17292f1e576 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:03.128492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4eb6-d6cc-4f01-b7f7-e17292f1e576 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:03.133832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:03.134472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:03.134750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:03.135025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:03.144088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:03.145665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998543-7822-4b47-975e-aed6f54d6ed0 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:03.155312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 770/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:05.211399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b55d-acfe-42af-ab02-cda52a546c88 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:05.211950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b55d-acfe-42af-ab02-cda52a546c88 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:05.211950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b55d-acfe-42af-ab02-cda52a546c88 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:05.213348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 755/1525] 10.222.0.64 () {54 vars in 960 bytes} [Wed May 11 06:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:05.218350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bbd5-3f38-4df3-82d4-418fd84a6f10 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:05.218725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bbd5-3f38-4df3-82d4-418fd84a6f10 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:05.218924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886bbd5-3f38-4df3-82d4-418fd84a6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:05.236263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1886bbd5-3f38-4df3-82d4-418fd84a6f10 None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:05.237429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1886bbd5-3f38-4df3-82d4-418fd84a6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:05.245706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 771/1526] 10.222.0.64 () {58 vars in 1057 bytes} [Wed May 11 06:37:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:05.254733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80b55d-acfe-42af-ab02-cda52a546c88 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:05.268327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80b55d-acfe-42af-ab02-cda52a546c88 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:05.273206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:05.273826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:05.274107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:05.274381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:05.282357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:05.283944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5a7da-3144-4e34-8c47-123462a461a5 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:05.293139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 756/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:14.456924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9551-f894-4867-8aa6-a4f2ed54732a None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:14.457453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9551-f894-4867-8aa6-a4f2ed54732a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:14.457558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9551-f894-4867-8aa6-a4f2ed54732a None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:14.458854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:14.463540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1092a7-277e-47c9-8ccb-a8e062b86bea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:14.463961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1092a7-277e-47c9-8ccb-a8e062b86bea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:14.464097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1092a7-277e-47c9-8ccb-a8e062b86bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:14.483347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2f1092a7-277e-47c9-8ccb-a8e062b86bea None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:14.484562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2f1092a7-277e-47c9-8ccb-a8e062b86bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:14.492239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:14.641634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb9551-f894-4867-8aa6-a4f2ed54732a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:14.655651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb9551-f894-4867-8aa6-a4f2ed54732a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:14.661160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:14.661800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:14.662080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:14.662387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:14.672875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:14.674451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb40317-971d-405a-bfec-e877d03ef12b service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:14.683657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 773/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:15.570039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d81fd-145a-42d4-812c-eb4bed8146ab None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:15.570601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d81fd-145a-42d4-812c-eb4bed8146ab None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:15.570601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d81fd-145a-42d4-812c-eb4bed8146ab None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:15.572265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 06:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:15.577137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ebc7-6bbc-4963-9fca-b61e56b38c89 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:15.578081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ebc7-6bbc-4963-9fca-b61e56b38c89 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:15.578171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ebc7-6bbc-4963-9fca-b61e56b38c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:15.596405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6120ebc7-6bbc-4963-9fca-b61e56b38c89 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:15.597569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6120ebc7-6bbc-4963-9fca-b61e56b38c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:15.605279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 06:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:37:15.755858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d81fd-145a-42d4-812c-eb4bed8146ab None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:15.770553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d81fd-145a-42d4-812c-eb4bed8146ab None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:15.775893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:15.776518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:15.776799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:15.777072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:15.784863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:15.786421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4b009-5534-4a28-9ca6-b1e1287f366c service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:15.795511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 759/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:19.948417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:19.948976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:19.948976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:19.950321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:19.955914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746c3e-7d67-48fe-8344-8ce70e52b6d2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:19.956324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746c3e-7d67-48fe-8344-8ce70e52b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:19.956466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746c3e-7d67-48fe-8344-8ce70e52b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:19.974390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3b746c3e-7d67-48fe-8344-8ce70e52b6d2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:19.975754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3b746c3e-7d67-48fe-8344-8ce70e52b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:19.984875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:20.023805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:20.025512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:20.089868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70440f40-b6c1-4468-b480-26e7c427109b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:20.093936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:20.094579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:20.094860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:20.095135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:20.103862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:20.105275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3eda-fee5-4271-b520-be2b1130c336 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:20.114333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 776/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:22.334312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cce17-7026-481c-b35f-471501f1f468 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:22.334876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cce17-7026-481c-b35f-471501f1f468 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:22.334876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cce17-7026-481c-b35f-471501f1f468 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:22.336248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:22.341677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69264-ffad-49ee-a571-10578920d3e0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:22.342079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69264-ffad-49ee-a571-10578920d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:22.342223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69264-ffad-49ee-a571-10578920d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:22.360143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c8b69264-ffad-49ee-a571-10578920d3e0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:22.361360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c8b69264-ffad-49ee-a571-10578920d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:22.369006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:22.403465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cce17-7026-481c-b35f-471501f1f468 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:22.414467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cce17-7026-481c-b35f-471501f1f468 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:22.417936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:22.418560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:22.418837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:22.419108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:22.428288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:22.429692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c4ddf-7386-4314-b318-b1a74f80de56 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:22.438817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 762/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:26.252667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:26.253239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:26.253239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:26.254599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 778/1540] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:26.259733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c84d-2710-413c-ad2e-b543b1e36529 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:26.260117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c84d-2710-413c-ad2e-b543b1e36529 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:26.260282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c84d-2710-413c-ad2e-b543b1e36529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:26.277468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b066c84d-2710-413c-ad2e-b543b1e36529 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:26.278634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b066c84d-2710-413c-ad2e-b543b1e36529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:26.286704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 763/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:26.559330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:26.560996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:26.616236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0543-ffa3-478b-bce1-eac4def42b47 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:26.619705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:26.620334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:26.620613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:26.620885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:26.629463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:26.630901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970dfbd-3281-4c79-8c1e-a12f52c16998 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:26.640663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 779/1542] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:37:28.909012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:28.909605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:28.909605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:28.911051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 764/1543] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 06:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:37:28.916520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445be68-a4c9-4c22-946e-e95ec352c348 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:28.917038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445be68-a4c9-4c22-946e-e95ec352c348 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:28.917137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445be68-a4c9-4c22-946e-e95ec352c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:28.936080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3445be68-a4c9-4c22-946e-e95ec352c348 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:37:28.937288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3445be68-a4c9-4c22-946e-e95ec352c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:28.945052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 780/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 06:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:37:29.231215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:37:29.232963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:37:29.246647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd0bb-0268-48d0-a915-c1d52b9a0b47 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:37:29.250240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:37:29.250881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:37:29.251163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:37:29.251464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:37:29.260513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:37:29.261916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc1ba9-dfd3-4934-ac66-ba834bf43e65 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:37:29.271696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 765/1545] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:00.422073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed146-f49e-4cdc-a92c-5ebf7ccd206f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.423310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed146-f49e-4cdc-a92c-5ebf7ccd206f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.423828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed146-f49e-4cdc-a92c-5ebf7ccd206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.432361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b5c4-70e5-4453-864a-ae93be6bd863 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.432796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b5c4-70e5-4453-864a-ae93be6bd863 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.433367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b5c4-70e5-4453-864a-ae93be6bd863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.457124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-841ed146-f49e-4cdc-a92c-5ebf7ccd206f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.458686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-841ed146-f49e-4cdc-a92c-5ebf7ccd206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.463248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d769b5c4-70e5-4453-864a-ae93be6bd863 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.469173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d769b5c4-70e5-4453-864a-ae93be6bd863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.477146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 781/1546] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.487784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 766/1547] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:00.488359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.488933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.489431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.497116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.498036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.498322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.521122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.522726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.526335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.531050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.542982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 767/1548] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.546229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 782/1549] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:00.548098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.551510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.558959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1773d-c0c5-4b1b-8617-b3171e2b9d4a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.566330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fa579-328b-486e-ac3c-6607ac0d07ed None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.570837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.572356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.572908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.573183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.573919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:00.574228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.575306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:00.575306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:39:00.575306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:39:00.576195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfbdd5-902c-450d-94f4-26deb7030ae5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.579326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.580264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.580827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.581313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.582264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:00.582779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.584656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa26ed-b99e-4b54-ad2e-75efa3846fdf admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.595975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 768/1550] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:00.596652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.596944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.597220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.605388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 783/1551] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:39:00.607775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.608293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.608783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.630356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.631673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.640397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 769/1552] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.641281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.642245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.643573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.652123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 784/1553] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.653051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.653972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70033505-98b4-4513-a3bc-bfc2aeb494c9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.663334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.664277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.664712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832cc5c-1104-474e-a2a5-8875c7824f7a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.664860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.665042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.665734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.668293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc74aa-9f17-4308-bfba-092ea2dfb9bd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.669861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.670535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.670935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.671211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.671916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.672982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:00.672982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:39:00.672982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:39:00.674100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedef4a-ad8a-4376-85d5-ec5c3d350827 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.699668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 770/1554] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:00.701904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294827df-c330-49f5-bee4-5aba61e9010a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.702213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294827df-c330-49f5-bee4-5aba61e9010a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.702472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294827df-c330-49f5-bee4-5aba61e9010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.710896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 785/1555] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:00.710896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09795-90ef-46c9-8f19-0b42fc660893 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.710896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09795-90ef-46c9-8f19-0b42fc660893 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.711889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09795-90ef-46c9-8f19-0b42fc660893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.721911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-294827df-c330-49f5-bee4-5aba61e9010a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.723129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-294827df-c330-49f5-bee4-5aba61e9010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.730637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-98b09795-90ef-46c9-8f19-0b42fc660893 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.732402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-98b09795-90ef-46c9-8f19-0b42fc660893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.781243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 771/1556] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.782529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915fdd2-bb10-4240-874f-4360a108bfd1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.782811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915fdd2-bb10-4240-874f-4360a108bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.783080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915fdd2-bb10-4240-874f-4360a108bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.792689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 786/1557] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.794538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.795770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.795770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.806331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1915fdd2-bb10-4240-874f-4360a108bfd1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.807553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1915fdd2-bb10-4240-874f-4360a108bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.812398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.813552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.815197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 772/1558] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.816450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.816728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.816997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.823512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 787/1559] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.824267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.833523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d12f3-7202-4925-86d7-b512af9bb85a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.838122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.838430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.838769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.839389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.839783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.839969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.840468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.843065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919064cc-31bf-4b54-b591-bc08618c9eb3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.848887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 773/1560] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.849635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.859692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96898566-2622-43f2-bc6b-13b2efbdcb9d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.866972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 788/1561] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:00.867129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.867129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.867129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.867431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946020-7c9d-4cc5-b414-732e6f527ab5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.867537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.867637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946020-7c9d-4cc5-b414-732e6f527ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.867637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946020-7c9d-4cc5-b414-732e6f527ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.867800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.867800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:00.867800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:39:00.867800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:39:00.868176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1120-f82c-4b2d-9c5b-0c507561d57e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.883542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-25946020-7c9d-4cc5-b414-732e6f527ab5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.884774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-25946020-7c9d-4cc5-b414-732e6f527ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.892572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 774/1562] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:00.894303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.894898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.895215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.899792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 789/1563] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.899792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206f43-d5b5-480d-9719-1c3aa71566fe None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.899792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206f43-d5b5-480d-9719-1c3aa71566fe None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.899792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206f43-d5b5-480d-9719-1c3aa71566fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.916866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e8206f43-d5b5-480d-9719-1c3aa71566fe None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.918041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e8206f43-d5b5-480d-9719-1c3aa71566fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.918268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.920067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.926339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 790/1564] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.927499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.927776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.928046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.928469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 775/1565] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.929266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.938668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dd77c-b4ea-4e76-ac8b-fac5ab0dab08 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.943111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.943853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.944204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.944541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.945329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:00.945797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.945934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:00.946984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:00.947764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.954845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 791/1566] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:00.955625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.962045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 776/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:00.962706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.967707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95dd5-78e7-43aa-a891-0a35b10287bc None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.972485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a18-126c-4dd6-8e1b-40a92bc29eff admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:00.972721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.973358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.973639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.973949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.974608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:00.974905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.976508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.977187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:00.977819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.978095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.978366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:00.979063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:00.980655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edef6f8-6fb5-4a84-8d45-b3bd2a85cb1e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:00.995467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 792/1568] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:00.995467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:00.995747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 777/1569] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:00.995747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:00.995747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:00.995747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.003018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb06102-2bc6-4673-896f-e9d9b16c24e8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.007582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.008231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.008512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.008788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.009505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.010075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:01.011084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.011237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:01.019565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 778/1570] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:01.020325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.021891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 793/1571] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.024170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.030833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a764b-f1f8-4ce2-85a8-76d171f2c790 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.034267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe721-611b-4e9c-a8c5-9721ff3f8c3a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.035420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.036058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.036333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.036608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.037329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:01.037609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.038953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.039186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.039621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.039898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.040168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.040874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:01.041173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.042723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.051483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 779/1572] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:01.052261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.061053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 794/1573] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:01.061053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.061373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a269ff-5ad1-495a-af02-ece204b3886d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.065798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.066425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.066702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.066970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.067701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:01.067997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.069570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.070129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e28af-fbbe-4e91-8819-2390460077e3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.074892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.076261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.076543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.076814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.077491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.079382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.082438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 780/1574] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:01.083223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.092838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca149f-068b-46dc-a9d7-ef0ce991a4dd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.098895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.099678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.099954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.100222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.100926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.102481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.108671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 795/1575] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.108671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.115378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 781/1576] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.115378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.122613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe6a-affd-41cd-9cee-ea3b0f664ad5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.171415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436978-7b77-4c71-9511-4e0c9396d8ea admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.176130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.176844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.177072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.177332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.177456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.178013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.178115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.178331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.178622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.179349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:01.179649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.179951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.181198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.201810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 782/1577] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:01.201810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.207293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321d673-2d76-4a5e-85f7-33ddfe3c688b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.211825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.212484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.213033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 796/1578] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.213177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.213323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.213739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.214081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.215760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.230380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 783/1579] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.231173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.240401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271579a-5d32-49ed-ae55-98efe9447461 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.273919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1925eb-18a3-47f6-bf1d-c6f84397870b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.279138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.279822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.280110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.280383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.281062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.282979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.296664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.297622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.297963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.298226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.298926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.301093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.309048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 797/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.310067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.330451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 784/1581] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.330451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.371035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8513a-a582-4214-aa97-a92bb5008ba9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.389712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cc2d9-9763-43bf-90c9-7f9b809faff9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.394329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.395014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.395332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.395610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.396285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.398167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.419345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 785/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.419999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.425549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.426240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.426516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.426786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.427559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.429406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.432480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da222e1c-5676-4c4e-b141-d314deb4108b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.437561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.438573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.438853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.439122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] PATH_INFO: `/v3/projects/80a73dd80c194b209b7d6ac24b49fdd8/users/bbe06f32f9634a65b0368d2345dfc768/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.454760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a73dd80c194b209b7d6ac24b49fdd8, user_id=bbe06f32f9634a65b0368d2345dfc768, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.457735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 798/1583] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.457735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.458638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.472472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 786/1584] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:01 2022] PUT /identity/v3/projects/80a73dd80c194b209b7d6ac24b49fdd8/users/bbe06f32f9634a65b0368d2345dfc768/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:01.473318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.524601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33704-a8f8-43ce-90fb-4445463a840d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.536826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22ace-a148-458d-965e-a240ee401baf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.541315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.541976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.542256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.542526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.543199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.546131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.566003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 787/1585] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.566892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.577499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ded9a0-0292-4fd8-a3a7-1fc3a52ce63f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.579879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.580550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.580833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.581110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.581794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.582223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.583119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.583431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.583706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] PATH_INFO: `/v3/projects/ea42234bb6844ce88afe0725d859863e/users/1f2d12e60ae147198c3940c510616285/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.583817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.597763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea42234bb6844ce88afe0725d859863e, user_id=1f2d12e60ae147198c3940c510616285, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.600882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.608749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 799/1586] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.609719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.616632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 788/1587] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:01 2022] PUT /identity/v3/projects/ea42234bb6844ce88afe0725d859863e/users/1f2d12e60ae147198c3940c510616285/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:01.617560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.668836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d235-d9b7-4e43-9453-bf5810a22471 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.673464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.674135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.674418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.674694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.675405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.675525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eb9cf-dcbc-4f06-8d07-5e6c2ed874ec admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.677324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.680311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.680909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.681186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.681455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.682126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.684081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.698088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 800/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.699054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.704761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 789/1589] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.705512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.709063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcff0f-d0f5-4814-aef2-3897e9c1759b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.713902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.714599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.714881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.715151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.715605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038c25-37f9-4386-b920-5fce9b45ab92 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.715942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.717603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72369-97fc-4636-913f-10c1cc134972 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.720277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.720955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.721241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.721522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.722204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.724116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.727378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 801/1590] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.728544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462550-41e2-491c-8627-5766710753cc None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.728826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462550-41e2-491c-8627-5766710753cc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.729101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50462550-41e2-491c-8627-5766710753cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.743711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 790/1591] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.748131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.755296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-50462550-41e2-491c-8627-5766710753cc None None] MFA Rules not processed for user `bbe06f32f9634a65b0368d2345dfc768`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:01.756496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-50462550-41e2-491c-8627-5766710753cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:01.757234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6f72-8491-4067-9512-73eba83e95ce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.761953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.763327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.763677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.764021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.764855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.766473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.776519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 791/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.780118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.789535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e0a4c-2813-4a6c-a624-8f5b239a6d5e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.794607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.795240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.795547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.795817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.796485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.798343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476747-5921-4ffb-b384-fd0a15e908ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.818426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 792/1593] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.819813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.820170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.820519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.823559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 802/1594] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:01.824495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50462550-41e2-491c-8627-5766710753cc None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.834708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50462550-41e2-491c-8627-5766710753cc None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.838854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:01.839296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.839942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.840067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:01.840219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.840486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.841187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.842754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.847928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 793/1595] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:01.848817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.852900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 803/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.857036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.858936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb765-7d0e-4d3e-9582-49c1b96fa8b9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.863570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.864224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.864502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.864794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.865481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.866534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244733-2e08-4050-988b-f1c48e86bf74 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.867076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.871006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.871689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.872548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.872830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.873549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.875133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.879100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 794/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.879937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.887957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 804/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.887957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.889378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d3069-0bf3-46b9-9202-da986554a40a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.893946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.894587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.894864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.895135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.895246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818a4e-d62d-4fc8-b40e-b58dec4647de admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.895874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.897557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.899727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.900351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.900632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.900911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.901615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.903211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.907379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 795/1599] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.908298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.916397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 805/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.916397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.919768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155f44c-c96e-4c37-beef-3d3828d8518d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.923942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0241b95-caca-477b-a0db-1d3491cc535b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.924285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.924919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.925195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.925468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.926193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.927811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.928429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.929044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.929322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.929601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.930267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.932207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.939153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 796/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.939986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.949324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb723014-d649-4367-93b2-02e4cf8568c2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:01.954561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:01.955208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:01.955521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:01.955796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:01.956498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:01.958062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:01.962635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 806/1602] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:01 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:01.962635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.970464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 797/1603] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:01.971103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:01.980212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83567-8069-488a-93e4-0c5a8127583e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.013240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd104-75ee-4e67-a961-5d2ec80df8a4 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.017123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.017792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.018071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.018344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.035160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.035842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.036119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.036387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.037096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.038659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.048754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 798/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:02.049512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.058552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1acc5f-c456-40b4-8c55-ae4d6de04c80 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.064014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.064855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.065131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.065402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] PATH_INFO: `/v3/projects/08265213a8e840179ab9d62cf0bc86ab/users/da53e103c1e74a9b8907a7076b234171/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.079336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08265213a8e840179ab9d62cf0bc86ab, user_id=da53e103c1e74a9b8907a7076b234171, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.079825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.081290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.081919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.091302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 807/1605] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:02.092297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.094786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 799/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/08265213a8e840179ab9d62cf0bc86ab/users/da53e103c1e74a9b8907a7076b234171/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.095460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.105110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863121-6937-465e-b43a-5319596d6795 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.165673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f100ef-b9e1-4133-b1de-2e68114e0275 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.168258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.169746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.170017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.170403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.171227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.171725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.172641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.172919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.173205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.173322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] PATH_INFO: `/v3/projects/0d1689ff62644e0c92c3bf8290b52b90/users/0334273a56994a7abfa3d72006f7a7a4/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.185856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 808/1607] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:02.186606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.192637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1689ff62644e0c92c3bf8290b52b90, user_id=0334273a56994a7abfa3d72006f7a7a4, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.196037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.197398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0a96-adce-40f3-8dca-d9233e071429 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.202962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.203818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.204085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.204390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.205258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.206764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.211216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 800/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/0d1689ff62644e0c92c3bf8290b52b90/users/0334273a56994a7abfa3d72006f7a7a4/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.216728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.218744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 809/1609] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:02.219562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.231986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e419b47-ef4e-4944-a77b-20e3dbacc05c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.295255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478e4c-40f0-4cf9-a297-2c8214526047 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.300486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.301168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.301484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.301761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.301935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.302452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.303570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.304075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.304355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] PATH_INFO: `/v3/projects/a8541ea614a44ce7b0bec785f723849f/users/2b2af35e12fc477387b443dd768274f4/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.304972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.323409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8541ea614a44ce7b0bec785f723849f, user_id=2b2af35e12fc477387b443dd768274f4, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.324744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:02.324744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:39:02.324744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:39:02.326716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10ba0c-9629-4492-8af1-9c097b136c06 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.327819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 801/1610] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:02.328417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.339165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec20db-19c2-42ea-8ee8-3e800836c055 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.344227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 810/1611] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/a8541ea614a44ce7b0bec785f723849f/users/2b2af35e12fc477387b443dd768274f4/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.345729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.346207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.346619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.366472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:02.367872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:02.410174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.411488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.412008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.412491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] PATH_INFO: `/v3/projects/578914d2c0d14d8c9e9b25bc06f21d7e/users/24013a3b479a43efbf639793b37879a3/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.437054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578914d2c0d14d8c9e9b25bc06f21d7e, user_id=24013a3b479a43efbf639793b37879a3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.440374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f719b8-4bf9-4759-af4e-1f5a4ebfb280 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.452780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 811/1612] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:02.453709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.463606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78004-3e8f-4c5f-a76f-bf496d571dd9 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.467374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 802/1613] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/578914d2c0d14d8c9e9b25bc06f21d7e/users/24013a3b479a43efbf639793b37879a3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.470553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.470851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.471133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.491075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:02.492983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:02.537531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.538881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.539424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.539931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] PATH_INFO: `/v3/projects/9749a39b055f44f897aee3e4a38a8e80/users/6bcf870ca89247289af7fed28395222f/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.557534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9749a39b055f44f897aee3e4a38a8e80, user_id=6bcf870ca89247289af7fed28395222f, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.562040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.576364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 803/1614] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:02.577653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.582427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 812/1615] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/9749a39b055f44f897aee3e4a38a8e80/users/6bcf870ca89247289af7fed28395222f/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.583499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.597731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15219bd7-1225-403b-b1e1-b59ab0729809 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.654640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.655573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.655855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.656131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] PATH_INFO: `/v3/projects/eb4348f294cc464f89b2334676442d25/users/e57cd656669e42bea86c8206b333bd6d/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.659967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51e8d-4165-4a0c-839b-1acfb1c7fb69 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.664867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.665620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.665972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.666319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.667046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.668911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87d90-cf19-4b9c-adfe-6d46e6ea5189 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.673247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4348f294cc464f89b2334676442d25, user_id=e57cd656669e42bea86c8206b333bd6d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.676251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.678736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 813/1616] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:02.680021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d7a4-7c0d-48fa-9354-4d62fd116d14 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.680302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d7a4-7c0d-48fa-9354-4d62fd116d14 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.680580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d7a4-7c0d-48fa-9354-4d62fd116d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.693756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 804/1617] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/eb4348f294cc464f89b2334676442d25/users/e57cd656669e42bea86c8206b333bd6d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:02.694510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.711096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8122d7a4-7c0d-48fa-9354-4d62fd116d14 None None] MFA Rules not processed for user `2b2af35e12fc477387b443dd768274f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:02.712324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8122d7a4-7c0d-48fa-9354-4d62fd116d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:02.764193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bbc3b-a2d1-4624-aafa-336e5901ee5c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.768868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.769715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.770159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.770594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.789285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 814/1618] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:02.790960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539022-163b-4b21-8c0d-07d7eb6c9ee3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.791244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539022-163b-4b21-8c0d-07d7eb6c9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.791560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539022-163b-4b21-8c0d-07d7eb6c9ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.834501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c9539022-163b-4b21-8c0d-07d7eb6c9ee3 None None] MFA Rules not processed for user `24013a3b479a43efbf639793b37879a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:02.835919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c9539022-163b-4b21-8c0d-07d7eb6c9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:02.862393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.867286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.877867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 805/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:02.878190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.888720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21635592-ff56-40ca-8e19-742a8b1bd3e7 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.893895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.894991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.896425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.896704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.910391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.911811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 815/1620] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:02.913682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c690-c4d9-43ad-a596-7e1d392b4d5d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.913682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c690-c4d9-43ad-a596-7e1d392b4d5d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.914099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c690-c4d9-43ad-a596-7e1d392b4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.915307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.929050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 806/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:02.929970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:02.942359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3b221-1326-4ee9-87ff-834718f83c31 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:02.949043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:02.950792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:02.951583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:02.952014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] PATH_INFO: `/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489/users/101aecaeeafc42e6b526f3ef5bcfbd09/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:02.954481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-df35c690-c4d9-43ad-a596-7e1d392b4d5d None None] MFA Rules not processed for user `6bcf870ca89247289af7fed28395222f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:02.956231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-df35c690-c4d9-43ad-a596-7e1d392b4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:02.971302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d343dab84b4f7bb8edcd5e3334d489, user_id=101aecaeeafc42e6b526f3ef5bcfbd09, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:02.974110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeffbc-0516-40e1-836a-9717d7372c35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:02.995772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 807/1622] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:02 2022] PUT /identity/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489/users/101aecaeeafc42e6b526f3ef5bcfbd09/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:03.001415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.001829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.002175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.020945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:03.022253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:03.041250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 816/1623] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:03.042886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644085-73e9-40e3-a1b0-2df5441fbaf8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.043228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644085-73e9-40e3-a1b0-2df5441fbaf8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.043780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644085-73e9-40e3-a1b0-2df5441fbaf8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.050246 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 817/1624] 10.222.0.64 () {54 vars in 961 bytes} [Wed May 11 06:39:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:03.051212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0644085-73e9-40e3-a1b0-2df5441fbaf8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.102984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 808/1625] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:03.104018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.114395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9e90a-b431-4886-9606-c26c81dd66c5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.119487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.120932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.121175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.121676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.123794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.125669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.140251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 809/1626] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:03.140886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0644085-73e9-40e3-a1b0-2df5441fbaf8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.145253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.148139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.149174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.149638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.150088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.150909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.154144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c2ff0-1dec-43ed-8180-ccdd14347b60 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.159787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc7b34-e10c-4f07-b8fc-3ad5e33f8efa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.169051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.169858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.172426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.172617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.173628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.176084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.195547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 818/1627] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:03.200016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.200989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.201427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.211396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 810/1628] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:03.211396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.224099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:03.225319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:03.281413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b6fb-f7f3-4f2d-b56f-ff3efdd18139 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.290502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.291501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.291971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.292418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.352437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 819/1629] 10.222.0.64 () {58 vars in 1058 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:03.358034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.383859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.388358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.410449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 811/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:03.411487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.426347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037f79-aff5-437e-8753-05af9b7e0aa1 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.440282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.441727 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.442217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.442694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.443627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.446596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.466824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3b17-2770-446e-9870-69e63ed3deff None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.471974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.473577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.473577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.473577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] PATH_INFO: `/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489/users/101aecaeeafc42e6b526f3ef5bcfbd09/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.476281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d343dab84b4f7bb8edcd5e3334d489, user_id=101aecaeeafc42e6b526f3ef5bcfbd09, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.479907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.489395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 812/1631] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/users => generated 306 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:03.490737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.503576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 820/1632] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:03 2022] PUT /identity/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489/users/101aecaeeafc42e6b526f3ef5bcfbd09/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:03.503576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.511176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164eb3-8972-43f0-b97b-226cc2fc5faf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.600214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.601270 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.601724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.602150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.603029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.605030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.629916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 813/1633] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:03.630679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.641097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450189-2477-4591-a568-81d0f35a7ffa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.646061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.646748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.647507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.647507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.648092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.649838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04348b2-900b-47dd-a30c-04a57b7faaa3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.652209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a39d-d1e7-4b56-9dbb-a8ea9f6fe318 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.665152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 814/1634] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:03.665152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.665152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.665152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.665753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.665753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.665753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.666037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.694360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] MFA Rules not processed for user `101aecaeeafc42e6b526f3ef5bcfbd09`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:03.695787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:03.744306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.745917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.757442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 821/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:03.758318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.769457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a34a-6841-4f29-8db5-19f80d9d4150 service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.779494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.780173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.780465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.780725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.781586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.783195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.793753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 815/1636] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:03.795495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.804630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 822/1637] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:03.805767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.817280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e018af-33c5-4378-a57b-a871c8be5182 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.824234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.825817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.826165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.826571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] PATH_INFO: `/v3/projects/547f63c3db9046c99be545dd007b8065/users/38f8039dd0f14942bc01ac896b8dc296/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:03.846725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547f63c3db9046c99be545dd007b8065, user_id=38f8039dd0f14942bc01ac896b8dc296, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:03.850952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:03.891179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 816/1638] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:03 2022] PUT /identity/v3/projects/547f63c3db9046c99be545dd007b8065/users/38f8039dd0f14942bc01ac896b8dc296/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:03.891179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:03.914974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d68ca-1db7-4e53-a417-dfcacf2cb640 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.994214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c17c-22d9-4ce4-9c5d-7bca5da18de5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:03.997799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:03.998658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:03.999216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:03.999963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.000094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.000936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.001350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.001801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] PATH_INFO: `/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5/users/aa038b95e7f84ad293040d4dbfb1ca4f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.022018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79503c66e4a245fabd4f1fd73b55bfd5, user_id=aa038b95e7f84ad293040d4dbfb1ca4f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.025605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.048548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 817/1639] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:03 2022] PUT /identity/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5/users/aa038b95e7f84ad293040d4dbfb1ca4f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:04.048548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.112657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.114668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.131406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 823/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:04.132485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.143627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536251a5-9712-4d21-822f-e733b3846c8c service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.166968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fc9c-10a9-4e8a-9dae-3f7d65b4d80e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.174633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.175540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.175826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.176162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.176886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.178566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd4ccc-abc0-4a32-9102-9e5c5b217bbc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.199093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 818/1641] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:04.201657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e068-12a4-4ef6-9ee4-ee717180c734 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.202017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e068-12a4-4ef6-9ee4-ee717180c734 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.202496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e068-12a4-4ef6-9ee4-ee717180c734 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.204297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 819/1642] 10.222.0.64 () {54 vars in 912 bytes} [Wed May 11 06:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:04.205117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e068-12a4-4ef6-9ee4-ee717180c734 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.226625 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e068-12a4-4ef6-9ee4-ee717180c734 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.233738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.234901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.235190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.235540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.236269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.237937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8b490-826a-4dd8-ab39-826a35b76862 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.239027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.239970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.240272 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.240644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] PATH_INFO: `/v3/projects/547f63c3db9046c99be545dd007b8065/users/38f8039dd0f14942bc01ac896b8dc296/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.251850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 824/1643] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:04.251850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.251850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.251850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.256910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] RBAC: Authorizing `identity:create_grant(project_id=547f63c3db9046c99be545dd007b8065, user_id=38f8039dd0f14942bc01ac896b8dc296, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.260283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.274882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:04.276424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:04.281169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 820/1644] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:04 2022] PUT /identity/v3/projects/547f63c3db9046c99be545dd007b8065/users/38f8039dd0f14942bc01ac896b8dc296/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:04.282088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.357827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67d88f-a653-4d31-960b-b523e97f887c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.363142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.364220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.375197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.375643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] PATH_INFO: `/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5/users/aa038b95e7f84ad293040d4dbfb1ca4f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.381321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79503c66e4a245fabd4f1fd73b55bfd5, user_id=aa038b95e7f84ad293040d4dbfb1ca4f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.385387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 825/1645] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:39:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:04.386481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.395655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6392cf-9cde-463a-a5f2-82d3193d58c3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.435800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 821/1646] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:04 2022] PUT /identity/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5/users/aa038b95e7f84ad293040d4dbfb1ca4f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:04.437351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.437648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.437933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.488098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be6a3-e3b8-4675-a9a1-2d4a2720d502 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.508005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] MFA Rules not processed for user `38f8039dd0f14942bc01ac896b8dc296`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:04.510428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:04.570892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.571888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.572373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.572972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.596932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 822/1647] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:04.597792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:04.608574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbce60-9355-42bc-ac65-47984745a304 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:04.613448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:04.614116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.614399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.614678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.678105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.679932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dde2b5-8004-46c2-a2a3-982d5e3929b4 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.707362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 826/1648] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:04.709385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:04.709739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:04.710197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:04.744203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] MFA Rules not processed for user `aa038b95e7f84ad293040d4dbfb1ca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:04.745617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:04.826333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:04.833669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:04.883968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 827/1649] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:04.899860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 823/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:05.188830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:05.213084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648971-6ef8-4485-a6db-cc4e01aa34b9 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:05.236250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:05.238642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:05.239050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:05.240705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:05.273973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:05.278808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430fcbd-3e7b-4e58-971f-d102a4ddf603 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:05.320499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 828/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:05.392223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:05.404322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18b67-1d37-4326-823e-cde37e9f678b service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:05.409488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:05.411182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:05.411821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:05.412208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:05.425744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:05.431476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:05.445550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 824/1652] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:06.135936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971891-4d79-4593-892f-c941e505841d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.136547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971891-4d79-4593-892f-c941e505841d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.136654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971891-4d79-4593-892f-c941e505841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.141875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:06.163349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a59c6-4292-4d87-bea6-4afa154e8816 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:06.174996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:06.177568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.178064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.179490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.218587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-13971891-4d79-4593-892f-c941e505841d None None] MFA Rules not processed for user `da53e103c1e74a9b8907a7076b234171`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:06.220109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-13971891-4d79-4593-892f-c941e505841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:06.345391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:06.348801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:06.378029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 825/1653] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:06.379020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:06.400117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7da0-b666-4a06-bb5a-514007bfb0c0 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:06.409755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 829/1654] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:06.409891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:06.410789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.411080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.411546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.423763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727d4e-8340-4616-a82f-5a5ce0cb5515 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.424052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727d4e-8340-4616-a82f-5a5ce0cb5515 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.424441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727d4e-8340-4616-a82f-5a5ce0cb5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.459498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6b727d4e-8340-4616-a82f-5a5ce0cb5515 None None] MFA Rules not processed for user `da53e103c1e74a9b8907a7076b234171`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:06.461146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6b727d4e-8340-4616-a82f-5a5ce0cb5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:06.479083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 830/1655] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:06.503601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7da31-86c1-4ca3-ae85-4edf2e9916d9 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.503888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7da31-86c1-4ca3-ae85-4edf2e9916d9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.504161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7da31-86c1-4ca3-ae85-4edf2e9916d9 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.506054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 831/1656] 10.222.0.64 () {54 vars in 961 bytes} [Wed May 11 06:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:39:06.517464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.517823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.518003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.555214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:06.557577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:06.576590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:06.577960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73e44b-ee09-45b8-8dde-b683a949272c service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:06.593443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 832/1657] 10.222.0.64 () {58 vars in 1058 bytes} [Wed May 11 06:39:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:06.594988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:06.610577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 826/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:06.612707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2cfb0-a704-41e4-915f-2c091b5321b5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:06.618483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:06.619159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:06.619452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:06.619732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:06.629559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:06.630649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783b57a-9b73-422e-9450-7d1bf173a9f9 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:06.654898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 833/1659] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:07.185140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:07.185761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:07.186053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:07.189110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 827/1660] 10.222.0.64 () {54 vars in 912 bytes} [Wed May 11 06:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:07.208830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0cf8f-6090-4ee4-a423-856e66c9bd58 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:07.209312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0cf8f-6090-4ee4-a423-856e66c9bd58 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:07.209405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0cf8f-6090-4ee4-a423-856e66c9bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:07.240342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-71e0cf8f-6090-4ee4-a423-856e66c9bd58 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:07.242456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-71e0cf8f-6090-4ee4-a423-856e66c9bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:07.293090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:07.294961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:07.303848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 834/1661] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:39:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:07.432589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4b8f-dd69-4922-891f-896d70f755f6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:07.442065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:07.442779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:07.443365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:07.443815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:07.476932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:07.478557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f5de-ec44-4466-85a1-3061893cc0f0 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:07.509815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 828/1662] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:08.162932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:08.163221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:08.163531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:08.165543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 835/1663] 10.222.0.64 () {54 vars in 912 bytes} [Wed May 11 06:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:08.181631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5931-2adf-4c73-a2c9-8523b2cd73a5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:08.182084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5931-2adf-4c73-a2c9-8523b2cd73a5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:08.182459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5931-2adf-4c73-a2c9-8523b2cd73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:08.291749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-25dd5931-2adf-4c73-a2c9-8523b2cd73a5 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:08.291749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-25dd5931-2adf-4c73-a2c9-8523b2cd73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:08.432236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 829/1664] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:39:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:08.455946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:08.457822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:08.490076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b4b3-e9f3-4c0a-a3e6-08606e45bbad None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:08.494665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:08.495582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:08.499103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:08.499687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:08.519311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:08.521111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa05c6f-0b92-4e5f-ad7c-ba63cc6eb2b7 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:08.540194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 836/1665] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:10.190420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd3f0-d7bd-415d-827c-9a217bdf78c1 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:10.190895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd3f0-d7bd-415d-827c-9a217bdf78c1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:10.190981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd3f0-d7bd-415d-827c-9a217bdf78c1 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:10.192757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 830/1666] 10.222.0.64 () {54 vars in 960 bytes} [Wed May 11 06:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:10.198830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:10.199323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:10.199407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:10.272691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] MFA Rules not processed for user `40643ca4e4db4ce6b0a692bb06cc6dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:10.274504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:10.484065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 837/1667] 10.222.0.64 () {58 vars in 1057 bytes} [Wed May 11 06:39:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:10.491830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd3f0-d7bd-415d-827c-9a217bdf78c1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:10.530541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd3f0-d7bd-415d-827c-9a217bdf78c1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:10.571241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:10.572437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:10.573201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:10.573631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:10.578943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:10.608671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:10.610304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc531bf-7ea9-4718-8e5f-6122a282a364 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:10.641829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 831/1668] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:12.267644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:12.495441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01044-6911-4ca6-828a-c206f2281f6a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:12.509666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:12.511725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:12.512022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:12.512330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] PATH_INFO: `/v3/users/bbe06f32f9634a65b0368d2345dfc768` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:12.514393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe06f32f9634a65b0368d2345dfc768)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:12.515622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: WARNING py.warnings [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:12.515622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: warnings.warn(msg) May 11 06:39:12.515622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: May 11 06:39:12.517101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:12.698395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe06f32f9634a65b0368d2345dfc768'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:12.700981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe06f32f9634a65b0368d2345dfc768'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:12.756320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe06f32f9634a65b0368d2345dfc768'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:12.787093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe06f32f9634a65b0368d2345dfc768'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:12.806714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe06f32f9634a65b0368d2345dfc768'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:12.823320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 838/1669] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:12 2022] DELETE /identity/v3/users/bbe06f32f9634a65b0368d2345dfc768 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:12.826970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:12.827691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:12.828098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:12.928930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:12.936443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:13.232665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 832/1670] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:13.260258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:13.264466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:13.536614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c0f48-ae32-493e-aec5-50e63c975d3e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:13.560546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:13.580948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:13.581286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:13.581549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:13.641703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:13.643191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:13.702240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 839/1671] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:14.647120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:14.653732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:14.703089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b63b1-e708-4295-86a7-3208c2373ed1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:14.736816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:14.737642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:14.737926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:14.738199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] PATH_INFO: `/v3/projects/80a73dd80c194b209b7d6ac24b49fdd8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:14.745764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a73dd80c194b209b7d6ac24b49fdd8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:14.751894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: WARNING py.warnings [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 06:39:14.751894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: warnings.warn(msg) May 11 06:39:14.751894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: May 11 06:39:14.763796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:14.852332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:14.856091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:14.925997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19d7fa-cce8-4724-855b-3b9a9d607381 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:15.019732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a73dd80c194b209b7d6ac24b49fdd8', 'request_id': 'req-e2ff880d-b8bb-44a8-bac5-632aedb37575'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.041867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a73dd80c194b209b7d6ac24b49fdd8', 'request_id': 'req-e2ff880d-b8bb-44a8-bac5-632aedb37575'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.076446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a73dd80c194b209b7d6ac24b49fdd8', 'request_id': 'req-e2ff880d-b8bb-44a8-bac5-632aedb37575'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.154019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] The token cache is being invalidate because project 80a73dd80c194b209b7d6ac24b49fdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:15.155505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.157280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:15.157877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.158956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.161084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 833/1672] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:14 2022] DELETE /identity/v3/projects/80a73dd80c194b209b7d6ac24b49fdd8 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:15.161662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.162274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] PATH_INFO: `/v3/users/24013a3b479a43efbf639793b37879a3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.164139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=24013a3b479a43efbf639793b37879a3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:15.166040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:15.176721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:15.179498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:15.229068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff880d-b8bb-44a8-bac5-632aedb37575 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:15.249147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:15.250383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.250842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.251296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] PATH_INFO: `/v3/users/101aecaeeafc42e6b526f3ef5bcfbd09` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.255600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101aecaeeafc42e6b526f3ef5bcfbd09)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:15.264967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:15.329178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24013a3b479a43efbf639793b37879a3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.330888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24013a3b479a43efbf639793b37879a3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.371140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24013a3b479a43efbf639793b37879a3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.388964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24013a3b479a43efbf639793b37879a3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.395095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101aecaeeafc42e6b526f3ef5bcfbd09'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.395832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101aecaeeafc42e6b526f3ef5bcfbd09'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.425724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7136ec91-88d5-4b30-834d-c2ecd9644adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24013a3b479a43efbf639793b37879a3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.436856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 840/1673] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:14 2022] DELETE /identity/v3/users/24013a3b479a43efbf639793b37879a3 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:15.440604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101aecaeeafc42e6b526f3ef5bcfbd09'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.443878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.446125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.447207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.459818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101aecaeeafc42e6b526f3ef5bcfbd09'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.461120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b88edeb6-6715-4b6f-847f-d9bcd34df049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101aecaeeafc42e6b526f3ef5bcfbd09'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:15.486344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:15.489244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:15.490993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 834/1674] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:15 2022] DELETE /identity/v3/users/101aecaeeafc42e6b526f3ef5bcfbd09 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:15.492619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.493113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.493581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.573915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] MFA Rules not processed for user `e57cd656669e42bea86c8206b333bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:15.581757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:15.683738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 841/1675] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:15.726504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 835/1676] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:15.736542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:15.739469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:15.744596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:15.748304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:15.892799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a576-6911-4728-8892-1b9338de0774 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:15.908448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:15.909306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.909730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.911121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.932534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:15.934037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33bdc0-3e77-4ec7-9f2c-7fd761ffbe3c service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:15.939865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb7af3-a9ae-4da1-a80b-76d4ad55f298 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:15.956849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 842/1677] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:15.958470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:15.959392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:15.959851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:15.960325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:15.970391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:15.972778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:15.985400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 836/1678] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:16.222870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.223388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.223913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.245550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:16.251078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.303033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927cef6-e7d1-4508-a044-cebfb9f31a81 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:16.315126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:16.319064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.319412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.319694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] PATH_INFO: `/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.326060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d343dab84b4f7bb8edcd5e3334d489)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:16.334124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:16.356717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] MFA Rules not processed for user `1f2d12e60ae147198c3940c510616285`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:16.357998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.483683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 843/1679] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:16.483997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d343dab84b4f7bb8edcd5e3334d489', 'request_id': 'req-739341e5-d9c7-437f-ae39-fa2574d8f807'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:16.495916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d343dab84b4f7bb8edcd5e3334d489', 'request_id': 'req-739341e5-d9c7-437f-ae39-fa2574d8f807'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:16.497008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:16.500057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.517757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d343dab84b4f7bb8edcd5e3334d489', 'request_id': 'req-739341e5-d9c7-437f-ae39-fa2574d8f807'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:16.534325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00468a-14d9-49c5-8c4c-6d72c815e10e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:16.545035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] The token cache is being invalidate because project f8d343dab84b4f7bb8edcd5e3334d489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:16.546830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:16.549161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-739341e5-d9c7-437f-ae39-fa2574d8f807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:16.557117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 837/1680] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:16 2022] DELETE /identity/v3/projects/f8d343dab84b4f7bb8edcd5e3334d489 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:16.559906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc3e3-49b1-4c6a-a002-638600217f0e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.560656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc3e3-49b1-4c6a-a002-638600217f0e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.560956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc3e3-49b1-4c6a-a002-638600217f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.611764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7dbdc3e3-49b1-4c6a-a002-638600217f0e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:16.615505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7dbdc3e3-49b1-4c6a-a002-638600217f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.671744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:16.672776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.673283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.673729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.680129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.722770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 838/1681] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:16.728607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.729281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.730370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.815397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:16.818698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:16.840576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 839/1682] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:16.847911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:16.886829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989d5-10e8-4c36-a9c7-6ee246dd8520 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:16.887581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:16.895478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:16.908047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:16.909079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.909579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.910066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.911111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:16.912749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:16.914825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ebb05-0228-4914-b6ee-6f517ed9496c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:16.921621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 844/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:16.967389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 840/1684] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:16.968795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:16.990374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6bc1-3dce-428d-9e34-ede9046e1af0 service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:16.993950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5dcfb-f550-428a-b135-50ba71360ad3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.994492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5dcfb-f550-428a-b135-50ba71360ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.995623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5dcfb-f550-428a-b135-50ba71360ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.996592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:16.997885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:16.998270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:16.998835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:16.999630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.003685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.066431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 845/1685] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:16 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:17.067702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.097504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ffb5dcfb-f550-428a-b135-50ba71360ad3 None None] MFA Rules not processed for user `0334273a56994a7abfa3d72006f7a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:17.106887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffb5dcfb-f550-428a-b135-50ba71360ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.259583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d76dd-876c-446f-b872-1f2088b18f9a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:17.271231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:17.276038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 841/1686] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:17.288807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.289094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.289376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.290095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.298506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dea29-fd7f-4cde-aa36-ca4682964be6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.300781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dea29-fd7f-4cde-aa36-ca4682964be6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.303116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dea29-fd7f-4cde-aa36-ca4682964be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.306980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.368020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-702dea29-fd7f-4cde-aa36-ca4682964be6 None None] MFA Rules not processed for user `0334273a56994a7abfa3d72006f7a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:17.370597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-702dea29-fd7f-4cde-aa36-ca4682964be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.388853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 842/1687] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:17.397677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.397969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 846/1688] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:17 2022] POST /identity/v3/users => generated 285 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:17.398559 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.399086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.400211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.408332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.456794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:17.458330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.553578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200a61-77a2-4caf-acbd-f75a176cf082 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:17.565482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:17.567077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.568045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.568694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.579516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 843/1689] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:17.581330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.585292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.606971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.608900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d1d15-b476-47c6-8c26-089739f85ae4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:17.617026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:17.617843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.619596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.620147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.623015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.628766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.629287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 847/1690] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:17.631579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.634629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.644545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 844/1691] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:17.645486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.648568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.677144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2279ab-1671-4083-b491-eef22abfcf7a service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:17.678614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a77c-06cb-4d24-a909-edde6c50a9ad admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:17.691888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:17.692770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.693043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.693313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] PATH_INFO: `/v3/projects/578914d2c0d14d8c9e9b25bc06f21d7e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.694498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578914d2c0d14d8c9e9b25bc06f21d7e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.696448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.697822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:17.700717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:17.701633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:17.702211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] PATH_INFO: `/v3/users/2b2af35e12fc477387b443dd768274f4` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:17.708395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2af35e12fc477387b443dd768274f4)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:17.713072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:17.810303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578914d2c0d14d8c9e9b25bc06f21d7e', 'request_id': 'req-e8e56d1f-462f-4965-8b76-36d578d59f04'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.812512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2af35e12fc477387b443dd768274f4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.813980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2af35e12fc477387b443dd768274f4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.817365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578914d2c0d14d8c9e9b25bc06f21d7e', 'request_id': 'req-e8e56d1f-462f-4965-8b76-36d578d59f04'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.831229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578914d2c0d14d8c9e9b25bc06f21d7e', 'request_id': 'req-e8e56d1f-462f-4965-8b76-36d578d59f04'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.851964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2af35e12fc477387b443dd768274f4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.852109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] The token cache is being invalidate because project 578914d2c0d14d8c9e9b25bc06f21d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:17.852332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.853716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.857026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 848/1692] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:17 2022] DELETE /identity/v3/projects/578914d2c0d14d8c9e9b25bc06f21d7e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:17.857922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.863504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:17.874221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2af35e12fc477387b443dd768274f4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.875423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2af35e12fc477387b443dd768274f4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:17.902013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 845/1693] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:17 2022] DELETE /identity/v3/users/2b2af35e12fc477387b443dd768274f4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:17.910647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:17.916599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:18.047365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56d1f-462f-4965-8b76-36d578d59f04 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:18.131688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65449101-7e21-45db-a388-d4fca2f84d38 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:18.149080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:18.150333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.151104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.151594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.151694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:18.152265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.152884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:18.153178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.153468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.156131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:18.164478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:18.190445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 849/1694] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:18.195177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:18.198706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:18.223206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024290-98b6-4e6f-b0ee-bc7979bdaf1c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:18.230932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:18.232199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.232734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.233222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] PATH_INFO: `/v3/users/38f8039dd0f14942bc01ac896b8dc296` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.234741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f8039dd0f14942bc01ac896b8dc296)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:18.239577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:18.339387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f8039dd0f14942bc01ac896b8dc296'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:18.341491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f8039dd0f14942bc01ac896b8dc296'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:18.380242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f8039dd0f14942bc01ac896b8dc296'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:18.392375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f8039dd0f14942bc01ac896b8dc296'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:18.395152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:18.396962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21feff-12ba-469a-a100-da5ae9d18e2c service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:18.413583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f8039dd0f14942bc01ac896b8dc296'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:18.421441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 846/1695] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:39:18.422901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ddd2f-2e72-4791-b957-1a6194d5c8a3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.423182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ddd2f-2e72-4791-b957-1a6194d5c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.423550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ddd2f-2e72-4791-b957-1a6194d5c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.444216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 850/1696] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:18 2022] DELETE /identity/v3/users/38f8039dd0f14942bc01ac896b8dc296 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:18.446265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:18.452059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:18.498601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-745ddd2f-2e72-4791-b957-1a6194d5c8a3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:18.503718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-745ddd2f-2e72-4791-b957-1a6194d5c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:18.694003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 847/1697] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:18.767690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d620eae-a682-4bfe-8346-96c68dbba5db admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:18.784179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:18.785567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.786530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.786953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] PATH_INFO: `/v3/projects/e91f1c6b79ce48a7b9bd3b3588ca4ba2/users/3bccc01f81e84c58a68198ec6b0ca381/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.826778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91f1c6b79ce48a7b9bd3b3588ca4ba2, user_id=3bccc01f81e84c58a68198ec6b0ca381, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:18.839865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:18.873574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 851/1698] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:18 2022] PUT /identity/v3/projects/e91f1c6b79ce48a7b9bd3b3588ca4ba2/users/3bccc01f81e84c58a68198ec6b0ca381/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:18.884973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be312-f717-4c51-b306-f22bd74b13ef None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:18.885802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be312-f717-4c51-b306-f22bd74b13ef None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:18.886215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be312-f717-4c51-b306-f22bd74b13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:18.970739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-833be312-f717-4c51-b306-f22bd74b13ef None None] MFA Rules not processed for user `3bccc01f81e84c58a68198ec6b0ca381`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:18.980611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-833be312-f717-4c51-b306-f22bd74b13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:19.168249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:19.170368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:19.235804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 848/1699] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:19.238749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11a-efdf-477b-bc09-6ca76d9ca9ed None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:19.239037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11a-efdf-477b-bc09-6ca76d9ca9ed None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:19.239325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d11a-efdf-477b-bc09-6ca76d9ca9ed None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:19.244248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 849/1700] 10.222.0.64 () {54 vars in 912 bytes} [Wed May 11 06:39:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:19.249250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d11a-efdf-477b-bc09-6ca76d9ca9ed None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:19.380004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd634dd-d7cc-413b-ac2c-26d2cbd396a5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:19.397651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:19.398381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:19.398663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:19.398938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:19.499463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d11a-efdf-477b-bc09-6ca76d9ca9ed None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:19.514552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:19.515190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:19.515420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:19.515693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:19.516388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:19.518277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01c4d1-1aaa-401b-91e6-a0173cfece9a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:19.609735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 850/1701] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:19 2022] POST /identity/v3/projects => generated 369 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:19.614870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:19.615152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:19.618760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:19.631255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:19.636593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:19.686917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 852/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:19.687932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:19.714988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:19.721530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:19.738031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32d0b-3701-4261-8e15-7a88e817ba05 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:19.882245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 851/1703] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:39:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:19.962813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:19.963457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:19.963756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:19.963999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:19.964697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:19.969457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.041071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.047030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 853/1704] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:19 2022] POST /identity/v3/users => generated 291 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:20.049326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.054227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af4ec-70e0-484c-8a91-27a7d7e1a565 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.073583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.074349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.074766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.077521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.084622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7ff30-1c90-4d33-894a-bf47c6c8c20b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.104363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.105329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.105481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.107867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.108007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.108736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.110399 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.118416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.156488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 854/1705] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:20.159717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.166422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 852/1706] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:20.198382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df491-af06-45c4-a23b-3651bddec5a9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.217594 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.218573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.218767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.225173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] PATH_INFO: `/v3/projects/e263d790065b403f830684139ce178d8/users/e26ece616ac74e83bcaeb7659c470ed9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.282822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e263d790065b403f830684139ce178d8, user_id=e26ece616ac74e83bcaeb7659c470ed9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.295679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc7226-5f48-45b2-93b0-bf2e517e8319 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.335524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 855/1707] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:20 2022] PUT /identity/v3/projects/e263d790065b403f830684139ce178d8/users/e26ece616ac74e83bcaeb7659c470ed9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:20.339780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.346476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.346745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.347019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.358991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234939c-729d-46e1-b98c-e9f1e5cd78d3 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.384875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:20.386375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:20.486629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.487593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.488088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.488567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.489497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.492871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.518389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 853/1708] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:20.519785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.526182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:20.591767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0dc4-d261-49c2-838d-788a2328844f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.616216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.617485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.617994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.618476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] PATH_INFO: `/v3/projects/547f63c3db9046c99be545dd007b8065` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.621193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] RBAC: Authorizing `identity:delete_project(project_id=547f63c3db9046c99be545dd007b8065)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.625350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.650724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 856/1709] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 11 06:39:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:20.654714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.710073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069a0d-47ed-451f-aa7e-5fa475a5dc28 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:20.731365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:20.733184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.736913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.737204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] PATH_INFO: `/v3/projects/e263d790065b403f830684139ce178d8/users/e26ece616ac74e83bcaeb7659c470ed9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:20.746934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e263d790065b403f830684139ce178d8, user_id=e26ece616ac74e83bcaeb7659c470ed9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:20.760334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:20.802590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 857/1710] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:20 2022] PUT /identity/v3/projects/e263d790065b403f830684139ce178d8/users/e26ece616ac74e83bcaeb7659c470ed9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:20.815380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:20.819440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:20.837818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547f63c3db9046c99be545dd007b8065', 'request_id': 'req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:20.880414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547f63c3db9046c99be545dd007b8065', 'request_id': 'req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:20.925848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547f63c3db9046c99be545dd007b8065', 'request_id': 'req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:20.972246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] The token cache is being invalidate because project 547f63c3db9046c99be545dd007b8065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:20.974007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:20.976156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a9f9dbe2-e1d7-4fe6-a3b6-2c98bf88017b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:20.983099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 854/1711] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:20 2022] DELETE /identity/v3/projects/547f63c3db9046c99be545dd007b8065 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:20.988839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:20.989533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:20.990024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.046414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6c59-b1d2-4ec9-a42c-b0ff74d15f22 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:21.056442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:21.057256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.057545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.057821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.062380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:21.065567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] MFA Rules not processed for user `e26ece616ac74e83bcaeb7659c470ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:21.068779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:21.092131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:21.094717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70314a-55ac-4e67-82a1-17a604cfd578 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:21.119675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 858/1712] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:21.121214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23894-5192-4264-9860-9cbe13c68758 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.122045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23894-5192-4264-9860-9cbe13c68758 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.122324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23894-5192-4264-9860-9cbe13c68758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.181077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-80e23894-5192-4264-9860-9cbe13c68758 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:21.187934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-80e23894-5192-4264-9860-9cbe13c68758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:21.342849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 855/1713] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:21.360208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:21.364995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:21.462189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 859/1714] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:21.471861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.472622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.472925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.558332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:21.560182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:21.562507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d951-d840-496b-beb9-c6f5a466ff61 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:21.570638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:21.571929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.572822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.573297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.598251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 860/1715] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:21.602549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:21.605319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:21.608790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:21.621022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de743e5-cd44-4b40-86e6-e17a53ff0748 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:21.635586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:21.636306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.636587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.636928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.637672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:21.637980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:21.640013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:21.640799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 856/1716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:21.679096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 861/1717] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:21.680245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:21.695737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef7315-f65c-4c3d-b8bb-5afb25844a75 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:21.707960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:21.712572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:21.712988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:21.713371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:21.714334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:21.726933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:21.817443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 857/1718] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:21 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:21.822034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:21.860996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2702-7980-494d-8a0a-de486fa626e8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:22.024741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:22.025502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.025860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.026238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.027223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:22.030424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:22.087987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 862/1719] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:21 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:22.093077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:22.109577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e9ae-07b7-4aa5-a720-ca97bc7c4a94 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:22.139325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:22.139817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.140154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.140537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.141387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:22.145402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:22.195536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:22.202768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 858/1720] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:22.217600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e17fb-bce5-477d-a8d0-9b47ba4363ae admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:22.236536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:22.241153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.241520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.242238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.244674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:22.258835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bdf8-283b-45c5-b79e-e9d843bb8fef admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:22.300939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:22.303003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 863/1721] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:22.321006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad4e1-b7d2-4fa6-97d5-1ce20cf32f65 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:22.343766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:22.344712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.344998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.345278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] PATH_INFO: `/v3/projects/f27df321610041abb50a5492be6c6f1c/users/101b82fb65084393852408344b9b8e45/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.404255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27df321610041abb50a5492be6c6f1c, user_id=101b82fb65084393852408344b9b8e45, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:22.417275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed8a72-c8af-4164-9caa-d24a5dfbc38e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:22.473370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 859/1722] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:22 2022] PUT /identity/v3/projects/f27df321610041abb50a5492be6c6f1c/users/101b82fb65084393852408344b9b8e45/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:22.484511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.485057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.485137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.628057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] MFA Rules not processed for user `101b82fb65084393852408344b9b8e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:22.635995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:22.900098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:22.900500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:22.901032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:22.932587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 864/1723] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:22.936913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:22.981255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] MFA Rules not processed for user `0334273a56994a7abfa3d72006f7a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:22.987042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:23.209345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76d4c-5b25-44ef-a56f-760644e1cbd5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:23.244185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:23.250582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:23.251109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:23.253472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:23.255801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:23.258174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:23.299398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 860/1724] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:23.409165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 865/1725] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:22 2022] POST /identity/v3/projects => generated 407 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:23.413715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:23.439485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a25bd-0e70-460b-90b9-afa23962dbea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:23.694617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:23.695509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:23.695900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:23.696286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:23.697097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:23.699629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:23.775346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 861/1726] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:23 2022] POST /identity/v3/users => generated 310 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:23.777095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:23.794497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650391-bd42-4211-8998-911390ea06cf admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:23.838888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:23.842901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:23.843303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:23.843599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:23.844361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:23.864319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:23.946842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:23.952780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 866/1727] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:23.974490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5577b54-0790-4d67-b8b9-68da1ec2eef1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:23.980610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:23.982504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:23.983072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:23.984219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] PATH_INFO: `/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb/users/e0d4f9827c864a0a8862f2bf5e2235ef/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.006138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac345a6c47cc4054a4d7aafc26fa71bb, user_id=e0d4f9827c864a0a8862f2bf5e2235ef, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:24.009866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:24.043544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 862/1728] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:23 2022] PUT /identity/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb/users/e0d4f9827c864a0a8862f2bf5e2235ef/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:24.048231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:24.080117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27747203-f747-4488-9c9f-5c5dcb42e24d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:24.098810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:24.101127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:24.393035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:24.395866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:24.398430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:24.402139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.403236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:24.414342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:24.456062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9470d-4834-4b35-a19b-5a8bce62a086 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:24.486131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:24.499586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:24.501112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:24.501662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] PATH_INFO: `/v3/projects/a8541ea614a44ce7b0bec785f723849f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.516894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 867/1729] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:24.519476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:24.528979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8541ea614a44ce7b0bec785f723849f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:24.535456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:24.581193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465ff9-6dff-4098-baaa-669a5ed11536 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:24.606939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:24.607916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:24.608189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:24.612818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] PATH_INFO: `/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb/users/e0d4f9827c864a0a8862f2bf5e2235ef/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.626008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac345a6c47cc4054a4d7aafc26fa71bb, user_id=e0d4f9827c864a0a8862f2bf5e2235ef, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:24.649200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fa3c9-625a-4369-a3ee-f59861d27b34 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:24.708802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8541ea614a44ce7b0bec785f723849f', 'request_id': 'req-708f4c4d-bdce-485f-bc02-8d445cc1e243'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:24.742512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8541ea614a44ce7b0bec785f723849f', 'request_id': 'req-708f4c4d-bdce-485f-bc02-8d445cc1e243'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:24.768645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 868/1730] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:24 2022] PUT /identity/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb/users/e0d4f9827c864a0a8862f2bf5e2235ef/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:24.768936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8541ea614a44ce7b0bec785f723849f', 'request_id': 'req-708f4c4d-bdce-485f-bc02-8d445cc1e243'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:24.771214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:24.772088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:24.773617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.800326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] The token cache is being invalidate because project a8541ea614a44ce7b0bec785f723849f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:24.801603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:24.802521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-708f4c4d-bdce-485f-bc02-8d445cc1e243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:24.825833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 863/1731] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:24 2022] DELETE /identity/v3/projects/a8541ea614a44ce7b0bec785f723849f => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:24.832875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257205b7-9c21-4c1e-8c55-e67240a7e689 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:24.839716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257205b7-9c21-4c1e-8c55-e67240a7e689 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:24.840997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257205b7-9c21-4c1e-8c55-e67240a7e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:24.866989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] MFA Rules not processed for user `e0d4f9827c864a0a8862f2bf5e2235ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:24.871618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:24.888512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-257205b7-9c21-4c1e-8c55-e67240a7e689 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:24.891087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-257205b7-9c21-4c1e-8c55-e67240a7e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:25.035007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 864/1732] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:25.044005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.044597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.045024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.088606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:25.092515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:25.117115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 869/1733] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:25.130825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.135824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:25.137929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 865/1734] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:25.142147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.160064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4148-a7cc-4835-981e-d5f8069c64f5 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.173651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.174712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.175208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.175741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.177854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:25.180479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.188285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:25.215902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 866/1735] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:39:25.219212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.244322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a5f1-b1c8-455b-bdfa-b34b131bee95 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.265541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.266552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.270446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.271933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.272787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.281365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:25.323908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eadcd-e33e-40ea-8867-5dca4e24244f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.339037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.342453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.346448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.349678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.388790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 867/1736] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:25.393685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.396164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.400002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55100de6-d0d5-4795-b2fd-42487792944a service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:25.452181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 870/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:25.636588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f125d-d246-4250-921d-cce210d4851d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.654991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.657079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.658066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.658762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.661863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.672362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:25.762838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.766045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.766558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.768430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 868/1738] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:25 2022] POST /identity/v3/users => generated 287 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:25.769743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.799039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ceed-8dc5-45d7-963d-03fe9886ed0b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.812313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] MFA Rules not processed for user `e57cd656669e42bea86c8206b333bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:25.815168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:25.862375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.866382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.866674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.866964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.880139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.882075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:25.917301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 869/1739] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:25.921154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:25.944485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b3c1-bad5-4bbd-b373-e8ec8809f334 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:25.961334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:25.962746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:25.963238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:25.963767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:25.965264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:25.969628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:26.014113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 870/1740] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:26.027568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:26.034719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 871/1741] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:26.063447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772985-1711-43e4-8c3c-7d8bbb2d7a3a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:26.092755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:26.093930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:26.094607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:26.095119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] PATH_INFO: `/v3/projects/6a8da625dd924ffabe01e2d90d1c98a8/users/db7af847092949699952ff91f0fecaad/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:26.132506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8da625dd924ffabe01e2d90d1c98a8, user_id=db7af847092949699952ff91f0fecaad, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:26.135506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784adfe-e4b0-400f-b124-0e07ac9d3ee6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:26.150089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:26.154850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:26.167605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 871/1742] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:26 2022] PUT /identity/v3/projects/6a8da625dd924ffabe01e2d90d1c98a8/users/db7af847092949699952ff91f0fecaad/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:26.193033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:26.193320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:26.193597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:26.268945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] MFA Rules not processed for user `db7af847092949699952ff91f0fecaad`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:26.271242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:26.399503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9d6d-c0f8-4275-b0af-511922c52ed0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:26.436805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 872/1743] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:26.504519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:26.506087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:26.506959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:26.507766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:26.510318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:26.691764 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:26.692996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:26.693458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:26.695237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:26.780297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 872/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:26 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:26.831302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:26.832778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:26.882797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb95efe-ea3f-48dd-b125-9dfabf90b173 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:26.919573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:26.931490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:26.931840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:26.934592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] PATH_INFO: `/v3/users/3bccc01f81e84c58a68198ec6b0ca381` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:26.944175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bccc01f81e84c58a68198ec6b0ca381)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:26.960616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:27.135009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3ea1-3092-4741-91fc-3782447c53fd service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:27.160075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:27.160895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:27.161190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:27.161453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:27.196003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:27.200315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583814af-8e84-4afc-b51f-f41b00ab4770 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:27.229389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bccc01f81e84c58a68198ec6b0ca381'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:27.231113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bccc01f81e84c58a68198ec6b0ca381'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:27.248461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 873/1745] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:27.287298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bccc01f81e84c58a68198ec6b0ca381'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:27.325134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bccc01f81e84c58a68198ec6b0ca381'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:27.328507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bccc01f81e84c58a68198ec6b0ca381'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:27.373381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 873/1746] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:26 2022] DELETE /identity/v3/users/3bccc01f81e84c58a68198ec6b0ca381 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:27.378139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a09c5-d3a5-4a79-81f2-d49086f39acc None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:27.378438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a09c5-d3a5-4a79-81f2-d49086f39acc None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:27.378670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a09c5-d3a5-4a79-81f2-d49086f39acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:27.437054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5c0a09c5-d3a5-4a79-81f2-d49086f39acc None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:27.438387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5c0a09c5-d3a5-4a79-81f2-d49086f39acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:27.656071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 874/1747] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:27.867714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:27.870147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:28.062873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb97a-5d64-42dc-a754-eac1fb91ddf5 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:28.064018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb97a-5d64-42dc-a754-eac1fb91ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:28.064488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb97a-5d64-42dc-a754-eac1fb91ddf5 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:28.066346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 875/1748] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:28.176734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f69c0-9784-4ce2-9ced-5a53801caa75 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:28.191711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:28.195233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:28.195906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:28.196383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:28.243632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:28.248462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283d54-97ff-4023-8a9b-e987cec7b2f6 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:28.298529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 874/1749] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:28.825239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:28.825833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:28.825833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:28.884669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:28.890815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:29.145786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 876/1750] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:39:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:29.532728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:29.534815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:29.535250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:29.596440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] MFA Rules not processed for user `1f2d12e60ae147198c3940c510616285`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:29.620514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:29.817189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:29.819027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:29.862387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3064b0-443d-4027-aa02-f01ce000c5f2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:29.874003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 875/1751] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:29.893205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:29.894028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:29.894306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:29.894806 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:29.924997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:29.927947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:29.967095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 877/1752] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:31.058880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:31.060979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:31.094554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8dbf3-5438-413f-811b-190988dda012 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:31.100395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:31.101571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:31.102047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:31.102520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] PATH_INFO: `/v3/projects/e91f1c6b79ce48a7b9bd3b3588ca4ba2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:31.105219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91f1c6b79ce48a7b9bd3b3588ca4ba2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:31.108439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:31.206785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91f1c6b79ce48a7b9bd3b3588ca4ba2', 'request_id': 'req-162bc631-2700-45fe-88b7-f3c58af41440'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.217679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91f1c6b79ce48a7b9bd3b3588ca4ba2', 'request_id': 'req-162bc631-2700-45fe-88b7-f3c58af41440'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.225240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91f1c6b79ce48a7b9bd3b3588ca4ba2', 'request_id': 'req-162bc631-2700-45fe-88b7-f3c58af41440'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.239533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] The token cache is being invalidate because project e91f1c6b79ce48a7b9bd3b3588ca4ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:31.240335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.241181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.242980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 876/1753] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:31 2022] DELETE /identity/v3/projects/e91f1c6b79ce48a7b9bd3b3588ca4ba2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:31.247563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:31.264374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db93ba-da7c-42d4-baae-d0ef5de37837 service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:31.359550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:31.360660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:31.362732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:31.363180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] PATH_INFO: `/v3/users/e26ece616ac74e83bcaeb7659c470ed9` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:31.365098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26ece616ac74e83bcaeb7659c470ed9)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:31.367371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:31.466346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26ece616ac74e83bcaeb7659c470ed9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.467701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26ece616ac74e83bcaeb7659c470ed9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.489408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26ece616ac74e83bcaeb7659c470ed9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.501410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26ece616ac74e83bcaeb7659c470ed9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.519064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-24cf625d-723e-44f5-bb6d-45438336561d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26ece616ac74e83bcaeb7659c470ed9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:31.529995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 878/1754] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:31 2022] DELETE /identity/v3/users/e26ece616ac74e83bcaeb7659c470ed9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:31.960633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:31.962925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:31.991572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc631-2700-45fe-88b7-f3c58af41440 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.092277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.094005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.094364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.094805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] PATH_INFO: `/v3/projects/e263d790065b403f830684139ce178d8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.096573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e263d790065b403f830684139ce178d8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.098765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.169353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e263d790065b403f830684139ce178d8', 'request_id': 'req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:32.178044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e263d790065b403f830684139ce178d8', 'request_id': 'req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:32.184173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e263d790065b403f830684139ce178d8', 'request_id': 'req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:32.196712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] The token cache is being invalidate because project e263d790065b403f830684139ce178d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:32.197085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:32.198116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a07a008e-750c-47e2-b23e-b1d52bf0a1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:32.199981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 877/1755] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:31 2022] DELETE /identity/v3/projects/e263d790065b403f830684139ce178d8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:32.205052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9585b1-8309-4930-918b-569f885884ba None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.205430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9585b1-8309-4930-918b-569f885884ba None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.205710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9585b1-8309-4930-918b-569f885884ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.223580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ce9585b1-8309-4930-918b-569f885884ba None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:32.224796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ce9585b1-8309-4930-918b-569f885884ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:32.292539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 879/1756] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:32.301432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.301717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.301988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.320607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:32.321803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:32.330932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 878/1757] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:32.335541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9585b1-8309-4930-918b-569f885884ba None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.347027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9585b1-8309-4930-918b-569f885884ba None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.352631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.353288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.353571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.355471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.356237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:32.356549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.358227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.372165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 880/1758] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:32.376123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.385878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7d32-1d72-4f28-89c3-3cc3ff7280fa None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.391752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.392567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.393058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.393410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.394194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.396414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.425554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 879/1759] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:32.429909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.441272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c757e-7b3d-4243-ae29-10c0bc41e5f0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.517421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.518169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.518456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.518738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.519527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.521687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.576715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 881/1760] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:32.581529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.601477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d27cf-bc6a-44c2-b077-d4730ee14964 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.614480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.615520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.616009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.616476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.617385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.619413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.631547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 880/1761] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:39:32.635584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.645278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0210-bd46-4362-b9a3-faad50ba0f31 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.650460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.651148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.651470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.651741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.652476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.654057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cfe09-6577-492c-9274-3a538c9aecfc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.664737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 882/1762] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:32.669387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.679686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595d8e-856d-4643-9b68-b9b6a3c52167 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.684917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.685805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.686088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.686364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] PATH_INFO: `/v3/projects/9a84fb213e6045e7a3f1c7adf1a16b22/users/143d2f49862c43a5a700c282ed8808d3/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.703326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a84fb213e6045e7a3f1c7adf1a16b22, user_id=143d2f49862c43a5a700c282ed8808d3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.706353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.721396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 881/1763] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:32 2022] PUT /identity/v3/projects/9a84fb213e6045e7a3f1c7adf1a16b22/users/143d2f49862c43a5a700c282ed8808d3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:32.732785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.733075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.733383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.762260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] MFA Rules not processed for user `143d2f49862c43a5a700c282ed8808d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:32.763411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:32.837822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 883/1764] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:32.842400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.917484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e2cc-abd9-4505-b35c-6d4943007fa9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:32.922724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:32.923429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:32.923713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:32.923971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:32.924665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:32.927904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:32.956730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 882/1765] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:32.960427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:32.971705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f6a3-432a-4a84-a903-d4ae700fc967 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.044217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.044829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.045109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.045389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.046080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.048150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.069128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 884/1766] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:32 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:33.073008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.085796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082048c-4147-407a-b226-0a48e72ae155 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.091188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.091944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.092291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.092847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.093421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.095123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.109181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 883/1767] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:39:33.113284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.123714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353d9bb-aa5f-49df-bf07-88ef73c80ad8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.131352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.131352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.131352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.131352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] PATH_INFO: `/v3/projects/5c2e98218fa44077b1146873e42e75a3/users/e17c3c61c23943a1bf79852e11a3fa22/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.159176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2e98218fa44077b1146873e42e75a3, user_id=e17c3c61c23943a1bf79852e11a3fa22, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.169577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.254653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 885/1768] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:33 2022] PUT /identity/v3/projects/5c2e98218fa44077b1146873e42e75a3/users/e17c3c61c23943a1bf79852e11a3fa22/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:33.258511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.289395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad124e-22d1-482a-9f2a-ebe106c11e1b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.386957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.387990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.388448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.388886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.389975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.392374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65eb7-e54c-494a-a8a4-540651c6fe78 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.407796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 884/1769] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:33.409187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.424098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d847-b84e-4e0a-9be9-e8558a008f64 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.431444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.433362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.434549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.435037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] PATH_INFO: `/v3/projects/5c2e98218fa44077b1146873e42e75a3/users/e17c3c61c23943a1bf79852e11a3fa22/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.438283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2e98218fa44077b1146873e42e75a3, user_id=e17c3c61c23943a1bf79852e11a3fa22, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.441776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.467513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 886/1770] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:33 2022] PUT /identity/v3/projects/5c2e98218fa44077b1146873e42e75a3/users/e17c3c61c23943a1bf79852e11a3fa22/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:33.472197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.472651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.472755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.511989 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] MFA Rules not processed for user `e17c3c61c23943a1bf79852e11a3fa22`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:33.514051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:33.620735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.624339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:33.697397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 885/1771] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:33.718940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:33.720574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:33.785119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e91683-8bc8-4f9a-bb48-7ba3daf400fc admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.792495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.794317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.794618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.794990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] PATH_INFO: `/v3/users/db7af847092949699952ff91f0fecaad` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.796508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7af847092949699952ff91f0fecaad)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.799402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.819212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f8f8-e8c7-4c1c-a10f-7cb5c61df170 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:33.832564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:33.833422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.833797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.834755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:33.883627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7af847092949699952ff91f0fecaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:33.884674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7af847092949699952ff91f0fecaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:33.900081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7af847092949699952ff91f0fecaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:33.920551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7af847092949699952ff91f0fecaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:33.937743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7af847092949699952ff91f0fecaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:33.942064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:33.944475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb22e-b8c1-4260-9dad-c584ec738c17 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:33.969331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 886/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:33.970093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 887/1773] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:33 2022] DELETE /identity/v3/users/db7af847092949699952ff91f0fecaad => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:33.981637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:33.982155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:33.982879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:34.041267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:34.042770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:34.200051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 887/1774] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:34.225591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:34.227289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:34.330642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6586d-9d7f-40d3-bdc1-49c6e6df1605 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:34.338199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:34.338662 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:34.339325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:34.339769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:34.364941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:34.370520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b862-b3c1-4a12-bf04-3e7ea2e7182e service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:34.394608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 888/1775] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:35.142746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:35.144578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:35.157971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f003fc-3853-4144-b1a9-5521b89c8a08 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:35.189662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:35.190757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.191764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.192357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] PATH_INFO: `/v3/projects/6a8da625dd924ffabe01e2d90d1c98a8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.195186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8da625dd924ffabe01e2d90d1c98a8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:35.197315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:35.308112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8da625dd924ffabe01e2d90d1c98a8', 'request_id': 'req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:35.317896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8da625dd924ffabe01e2d90d1c98a8', 'request_id': 'req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:35.326743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8da625dd924ffabe01e2d90d1c98a8', 'request_id': 'req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:35.343170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] The token cache is being invalidate because project 6a8da625dd924ffabe01e2d90d1c98a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:35.343513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:35.344179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-04587d0d-6e17-4a9f-b0e6-d81fb21e77d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:35.351500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.352159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 888/1776] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:35 2022] DELETE /identity/v3/projects/6a8da625dd924ffabe01e2d90d1c98a8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:35.352581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.353080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.378505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:35.380500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:35.492522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 889/1777] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:35.500896 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.501474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.502457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.531548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:35.532665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:35.561168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 889/1778] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:35.566452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:35.595150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e7796-2851-4786-a88f-a9892e37bd6c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:35.603238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:35.604245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.604880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.605896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.607391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:35.608180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:35.610110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:35.629667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 890/1779] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:35.635541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:35.645312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541da68-23e1-428f-b672-5a7b94d40648 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:35.651755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:35.652874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.653254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.653626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.654424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:35.656877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457cd1a-989f-4517-aed8-f8898d32e7e9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:35.702640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 890/1780] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:35 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:35.702942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:35.717904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc4db-d04d-400a-a6f0-d49a0ae3750f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:35.746745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e897-bdf4-4f75-941e-03e7206ea2a0 None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.747043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e897-bdf4-4f75-941e-03e7206ea2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.747415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e897-bdf4-4f75-941e-03e7206ea2a0 None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.749426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 891/1781] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:39:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:35.771362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.771610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.772043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.807776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:35.810509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:35.885048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:35.897380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:35.897855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:35.898894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:35.900478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:35.908414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:35.952689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 891/1782] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:35 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:35.955653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:35.982181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1dbc-c88b-4c86-b51c-631e7fcb5971 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.000496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.001197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.001483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.001761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.002496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.008321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.014815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 892/1783] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:36.028493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.031120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:36.036325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 892/1784] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:36.037368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.056829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ff34-db58-41c6-b148-f1a79c8af579 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.063920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.072436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.073166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.073605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.074617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.076563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.086662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee216e-4648-44cc-92a6-7782c9aa45bf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.095859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.097471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.099972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.114710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.117810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 893/1785] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:36.124450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.146132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.148338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508734-9ddf-4251-8986-ff284b151914 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.153213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8abf9-6788-4996-8a8b-08a9d008ccf9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.169268 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.172482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.172957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.173556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] PATH_INFO: `/v3/projects/3ffaa9f28aa2420196dabde6a5daa0e1/users/f253c7e75d334629a745eb524dca9177/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.183467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 893/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:36.190565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffaa9f28aa2420196dabde6a5daa0e1, user_id=f253c7e75d334629a745eb524dca9177, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.194944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.214513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 894/1787] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:36 2022] PUT /identity/v3/projects/3ffaa9f28aa2420196dabde6a5daa0e1/users/f253c7e75d334629a745eb524dca9177/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:36.226206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da953-8606-430c-aa07-41b1323c0279 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.226891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da953-8606-430c-aa07-41b1323c0279 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.227357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da953-8606-430c-aa07-41b1323c0279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.261331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-449da953-8606-430c-aa07-41b1323c0279 None None] MFA Rules not processed for user `f253c7e75d334629a745eb524dca9177`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:36.265296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-449da953-8606-430c-aa07-41b1323c0279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:36.387855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 894/1788] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:36.398408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.400865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:36.520015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5056b-4561-4563-92f5-9d1de67d4efa admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.527024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.528368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.528568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.528842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.537665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.539637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.552905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 895/1789] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:36.795841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da953-8606-430c-aa07-41b1323c0279 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.868506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da953-8606-430c-aa07-41b1323c0279 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.873809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.874759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.875117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.875494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] PATH_INFO: `/v3/users/f253c7e75d334629a745eb524dca9177` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.876908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f253c7e75d334629a745eb524dca9177)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.878926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.894209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:36.895610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:36.916187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcbd70-a860-4091-b4b5-174b89635e6a service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:36.921166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:36.922300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:36.922583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:36.922896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] PATH_INFO: `/v3/users/101b82fb65084393852408344b9b8e45` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:36.924189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] RBAC: Authorizing `identity:delete_user(user_id=101b82fb65084393852408344b9b8e45)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:36.926124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:36.947335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f253c7e75d334629a745eb524dca9177'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.948980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f253c7e75d334629a745eb524dca9177'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.969130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f253c7e75d334629a745eb524dca9177'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.979383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f253c7e75d334629a745eb524dca9177'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.980328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-484e97f9-67e0-4688-9e85-f0c9ee88c2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f253c7e75d334629a745eb524dca9177'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.992860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101b82fb65084393852408344b9b8e45'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:36.993561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101b82fb65084393852408344b9b8e45'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.000974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 895/1790] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:36 2022] DELETE /identity/v3/users/f253c7e75d334629a745eb524dca9177 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:37.002393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.002679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.002954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.010634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101b82fb65084393852408344b9b8e45'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.017960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101b82fb65084393852408344b9b8e45'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.025599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4ad14302-d27d-4f77-9ce3-87149822994a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101b82fb65084393852408344b9b8e45'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.029215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:37.030497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.031775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 896/1791] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:36 2022] DELETE /identity/v3/users/101b82fb65084393852408344b9b8e45 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:37.036302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.036534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.036812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.053602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:37.054891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.091783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 896/1792] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:37.101314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:37.102653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.117447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 897/1793] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:37.127474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:37.128784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.163658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f07ef-8d9e-40e5-9679-858275d6f2f7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:37.168385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:37.169038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.169318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.169615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.184111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:37.185574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:37.194287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4c63-6e6a-4236-aeb3-584111aceba8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:37.195628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 897/1794] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:37.204517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:37.205695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.205978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.206377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.216822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:37.218432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:37.228380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 898/1795] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:37.581901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:37.583696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.609002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6de19-d18d-4d5b-b2c0-452056ac7ea7 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:37.614147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:37.615656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.615945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.616301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] PATH_INFO: `/v3/projects/f27df321610041abb50a5492be6c6f1c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.617420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27df321610041abb50a5492be6c6f1c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:37.619408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:37.672337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27df321610041abb50a5492be6c6f1c', 'request_id': 'req-b0237835-1fab-4a21-afde-faf9ec221b14'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.681923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27df321610041abb50a5492be6c6f1c', 'request_id': 'req-b0237835-1fab-4a21-afde-faf9ec221b14'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.687800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27df321610041abb50a5492be6c6f1c', 'request_id': 'req-b0237835-1fab-4a21-afde-faf9ec221b14'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.698773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:37.700748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.716524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] The token cache is being invalidate because project f27df321610041abb50a5492be6c6f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:37.717164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.718920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.723916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 898/1796] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:37 2022] DELETE /identity/v3/projects/f27df321610041abb50a5492be6c6f1c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:37.724005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c26af-9c78-4a87-89dc-045d2af70fd0 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:37.724961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:37.727201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.798410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:37.799337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.799592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.800398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] PATH_INFO: `/v3/projects/3ffaa9f28aa2420196dabde6a5daa0e1` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.801184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffaa9f28aa2420196dabde6a5daa0e1)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:37.803104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:37.803710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0237835-1fab-4a21-afde-faf9ec221b14 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:37.808475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:37.809345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.809626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.809900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] PATH_INFO: `/v3/users/e0d4f9827c864a0a8862f2bf5e2235ef` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.811094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d4f9827c864a0a8862f2bf5e2235ef)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:37.813023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:37.853019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffaa9f28aa2420196dabde6a5daa0e1', 'request_id': 'req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.858175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffaa9f28aa2420196dabde6a5daa0e1', 'request_id': 'req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.859082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d4f9827c864a0a8862f2bf5e2235ef'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.859774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d4f9827c864a0a8862f2bf5e2235ef'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.864057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffaa9f28aa2420196dabde6a5daa0e1', 'request_id': 'req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.872303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d4f9827c864a0a8862f2bf5e2235ef'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.876862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] The token cache is being invalidate because project 3ffaa9f28aa2420196dabde6a5daa0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:37.877150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.877771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1661eda2-fbee-437f-a2f6-8eb5c0da12e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.879348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 899/1797] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:37 2022] DELETE /identity/v3/projects/3ffaa9f28aa2420196dabde6a5daa0e1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:37.880073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d4f9827c864a0a8862f2bf5e2235ef'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.880833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-da3c2102-48f7-40b8-bb43-8afe6d3d197d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d4f9827c864a0a8862f2bf5e2235ef'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:37.884225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.884526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.884797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.894345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 899/1798] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:37 2022] DELETE /identity/v3/users/e0d4f9827c864a0a8862f2bf5e2235ef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:37.905166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:37.906354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:37.967743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 900/1799] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:37.975605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:37.975898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:37.976179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:37.995288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:37.996502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.004299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 900/1800] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:38.008572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.018603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cdd3a-8935-43ff-b2e5-408972755e1b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.024890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.025667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.025946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.026478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.027276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:38.028092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.029670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.047507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.057141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329c19-e617-45ba-bfc0-c64873cd8cc0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.057780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 901/1801] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:39:38.062718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.063433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.063712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.063982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.064654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.066581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.098781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 901/1802] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:38.099940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.110660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-f12f-472f-bea1-9df3e9920292 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.168562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.169279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.169564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.169838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.170532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.172461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.197930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 902/1803] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:38.198903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.199744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.201266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.212889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc19f-1ac7-42ac-88fa-1909f0489bda admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.216767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5180d83-2575-4dda-9af0-b1b91aef009f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.217619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.218346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.218643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.218969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.219743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.221339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.222088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.223072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.223588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.224100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] PATH_INFO: `/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.225551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac345a6c47cc4054a4d7aafc26fa71bb)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.227715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.235312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 903/1804] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:38.236910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.247138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b931888-fc06-476e-884a-219e915c1fd2 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.251996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.252638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.252922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.253195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.253999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.255774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.267359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 904/1805] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:39:38.271212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.276934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac345a6c47cc4054a4d7aafc26fa71bb', 'request_id': 'req-41546242-578b-4373-8ecf-b4d25b7e2a3b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:38.280590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6faa1-3209-421a-85cc-267e8b95be78 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.291961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac345a6c47cc4054a4d7aafc26fa71bb', 'request_id': 'req-41546242-578b-4373-8ecf-b4d25b7e2a3b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:38.300126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac345a6c47cc4054a4d7aafc26fa71bb', 'request_id': 'req-41546242-578b-4373-8ecf-b4d25b7e2a3b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:38.312939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] The token cache is being invalidate because project ac345a6c47cc4054a4d7aafc26fa71bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:38.313257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:38.313959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-41546242-578b-4373-8ecf-b4d25b7e2a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:38.316044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 902/1806] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:38 2022] DELETE /identity/v3/projects/ac345a6c47cc4054a4d7aafc26fa71bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:38.321026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea663-be09-473a-b37e-7469783ea56d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.321579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea663-be09-473a-b37e-7469783ea56d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.321867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea663-be09-473a-b37e-7469783ea56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.340955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-015ea663-be09-473a-b37e-7469783ea56d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:38.342055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.342215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-015ea663-be09-473a-b37e-7469783ea56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.343000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.343298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.343570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] PATH_INFO: `/v3/projects/c151aa2912654ab4a91373dca155ec62/users/67f6ca7b0d0441f1bad3f288a81a4dd3/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.350081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 903/1807] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:38.358116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.363279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.363598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.364168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c151aa2912654ab4a91373dca155ec62, user_id=67f6ca7b0d0441f1bad3f288a81a4dd3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.367587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a64a-45a8-4a5e-b63a-43de3824e909 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.387381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 905/1808] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:38 2022] PUT /identity/v3/projects/c151aa2912654ab4a91373dca155ec62/users/67f6ca7b0d0441f1bad3f288a81a4dd3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:38.387599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:38.387599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.393344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.393711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.393865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.423846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] MFA Rules not processed for user `67f6ca7b0d0441f1bad3f288a81a4dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:38.425067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.456946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 904/1809] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:38.460961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.477176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e587cf1-9735-456b-bcd2-171c09bc8c08 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.482101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.482860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.483215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.483591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.484398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:39:38.484709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.486285 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.499940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 906/1810] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:38.502015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 905/1811] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:39:38.506364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.506514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.508023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.516895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f95e40-e084-494c-8aee-aa380fc4df02 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.521917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.522594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.522869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.523320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.523874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7449f0-e277-41c5-a56b-bb4a1b160889 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.524152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.526015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.528842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.529501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.529784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.530406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.531099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.533134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.559442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 906/1812] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:38.560747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.562509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 907/1813] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:38.566702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.631756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd1cf-72cf-4bf2-8f99-4eb5cc42d6f9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.632307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481a7-2f45-4f1e-a0d0-229ff383344c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.638105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.638601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.638806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.639045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.639760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.639880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.640095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.640190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.640562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.641316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.642833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.643565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.672102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 907/1814] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:38.675701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 908/1815] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:38.676438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.676552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.687080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae94e-407f-4dff-b563-2116533effae admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.690596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f760-e3c1-4ea6-ac82-e638f7dec7f3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.692012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.692671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.692950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.693220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.693939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.695547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.695829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.696505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.696789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.697059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.698174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.699830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.706559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 909/1816] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:38.710533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.711968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 908/1817] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:38.715599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.720449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911af9-ca66-4f97-98f5-072607342358 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.725243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.725477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e022-8052-4888-8f1b-cdcc7812afdb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.726057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.726518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.726791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] PATH_INFO: `/v3/projects/9da305b2fccc40ec9266385fe195ea51/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.730001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.733408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.733408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.733408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.733408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.734690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.747089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 909/1818] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:39:38.749421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da305b2fccc40ec9266385fe195ea51, user_id=3e5e7f0ae5ff4e0493e3f2ca41570b6a, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.751067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.753144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.764096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf55bb-f85d-4c60-8e22-038da8d1f02e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.770853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.771803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.772073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.772348 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] PATH_INFO: `/v3/projects/80a00152abc54da5959c7d9444dd9d2e/users/b8925bd259d1480191af590102ad878c/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.777827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 910/1819] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:38 2022] PUT /identity/v3/projects/9da305b2fccc40ec9266385fe195ea51/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:38.779067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.854334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d259-b285-417b-957d-3244bb381f1a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.859837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.860715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.861002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.861265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.861997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.863690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.875617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 911/1820] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:39:38.879300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:38.889897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bff226-085f-4fb8-9c64-a3ca3fb4aa61 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:38.894844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:38.895850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.896127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.896403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] PATH_INFO: `/v3/projects/9da305b2fccc40ec9266385fe195ea51/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.898605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da305b2fccc40ec9266385fe195ea51, user_id=3e5e7f0ae5ff4e0493e3f2ca41570b6a, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.901272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2fa17-d305-40c7-a260-ce55f2f7c118 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.913396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 912/1821] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:38 2022] PUT /identity/v3/projects/9da305b2fccc40ec9266385fe195ea51/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:38.926037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.926319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.926597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.930906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a00152abc54da5959c7d9444dd9d2e, user_id=b8925bd259d1480191af590102ad878c, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:38.933755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f324f2-df9e-440d-8312-c2fd747513a3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:38.959377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 910/1822] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:38 2022] PUT /identity/v3/projects/80a00152abc54da5959c7d9444dd9d2e/users/b8925bd259d1480191af590102ad878c/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:38.965369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] MFA Rules not processed for user `3e5e7f0ae5ff4e0493e3f2ca41570b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:38.965680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af474-3d21-4915-b40c-f8796e56502c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:38.966287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af474-3d21-4915-b40c-f8796e56502c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:38.966833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:38.966962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af474-3d21-4915-b40c-f8796e56502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:38.997911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-846af474-3d21-4915-b40c-f8796e56502c None None] MFA Rules not processed for user `b8925bd259d1480191af590102ad878c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:38.999300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-846af474-3d21-4915-b40c-f8796e56502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:39.047349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 913/1823] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:39.058890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.060267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:39.074965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 911/1824] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:39.079236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846af474-3d21-4915-b40c-f8796e56502c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.116144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70d232-95e5-4ac6-be3c-d7cebc592aec None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.119763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.120404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.120693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.120992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.130129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.131602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.139312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846af474-3d21-4915-b40c-f8796e56502c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.141571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 914/1825] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:39.144280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.145016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.145305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.145576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.146265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.148517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.178392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 912/1826] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:39 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:39:39.182574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.193509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacafc23-4e7a-4eaa-a756-5673beaeddd0 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.224407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.227214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:39.267868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.268658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.268942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.269235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.270500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.272473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.297693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 915/1827] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:39 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:39.297693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.300005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa853a-6d27-4fa2-aa01-e360ccc22739 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.303658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.304304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.304584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.304852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.305859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfdd08-6d47-433e-a5b2-4e5ac3e5b576 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.310094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.310714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.310998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.311291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.313121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:39.359837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.361268 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.369908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 913/1828] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:39:39.370696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.373573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.375013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.381325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9ecd-8089-4603-80b1-4a749a9214a4 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.384768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 916/1829] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:39.386148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.386871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.387153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.387563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.388286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.390260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.400283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 914/1830] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:39.404171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.415843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca456e05-4cce-4fa0-a251-e73c880b4aa6 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.421373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.422050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.422370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.422612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.423424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.425994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d381d-c719-4e7b-b4ad-a3f518c6bc1c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.439322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 917/1831] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:39.441722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.453735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be25f6-6247-4c03-a178-f79c558ae275 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.459798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.460855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.461093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.461412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] PATH_INFO: `/v3/projects/30aca388866a4d1dae00de7b07157f0b/users/782f79ae37bf475ab1d8a5b386eb1b4d/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.477719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aca388866a4d1dae00de7b07157f0b, user_id=782f79ae37bf475ab1d8a5b386eb1b4d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.481102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.503464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 915/1832] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:39 2022] PUT /identity/v3/projects/30aca388866a4d1dae00de7b07157f0b/users/782f79ae37bf475ab1d8a5b386eb1b4d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:39.514222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.514538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.514783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.549215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] MFA Rules not processed for user `782f79ae37bf475ab1d8a5b386eb1b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:39.550419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:39.615431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 918/1833] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:39.619990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.684938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a196994-c5b3-45d9-870e-ffb645cab97a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.691038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.691753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.692123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.692400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.693094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.695426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.727649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 916/1834] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:39:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:39.731919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.743097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbcf4a-5aa4-4c5f-9dce-77a9371371c0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.796562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.797154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.797427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.797692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.798355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.800285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.818815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 919/1835] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:39:39 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:39:39.822963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.832937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cc681-bf01-4ead-acd7-43c67ce62fbe admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.837620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.838273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.838556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.838829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.840076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.841658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.851760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 917/1836] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:39.856220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.865643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187514b-1b87-4fc2-bf5c-926c182dc7bd admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.870062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.870961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.871218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.871511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] PATH_INFO: `/v3/projects/7b90458004494ff8b06ee980dd63ea90/users/fd67c9a7e32d454bac919c607508196c/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.885865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b90458004494ff8b06ee980dd63ea90, user_id=fd67c9a7e32d454bac919c607508196c, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.888605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.901032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 920/1837] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:39 2022] PUT /identity/v3/projects/7b90458004494ff8b06ee980dd63ea90/users/fd67c9a7e32d454bac919c607508196c/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:39.905436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.915088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720533-6fec-403f-95ff-7663acb3ecad admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:39.970162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:39.970887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:39.971165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:39.971474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:39.972190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:39.973762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb67ca-7a1a-4773-a2b4-8e2ee7470f7c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:39.984581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 918/1838] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:39:39.988324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:39.999024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcc30d-54ed-4d6f-8f74-1ff0c9ac6cbe admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:40.015604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:40.016623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:40.016971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:40.017314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] PATH_INFO: `/v3/projects/7b90458004494ff8b06ee980dd63ea90/users/fd67c9a7e32d454bac919c607508196c/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:40.020090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b90458004494ff8b06ee980dd63ea90, user_id=fd67c9a7e32d454bac919c607508196c, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:40.022739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:40.033972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 921/1839] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:39:39 2022] PUT /identity/v3/projects/7b90458004494ff8b06ee980dd63ea90/users/fd67c9a7e32d454bac919c607508196c/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:39:40.046320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:40.046320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:40.046320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:40.071883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] MFA Rules not processed for user `fd67c9a7e32d454bac919c607508196c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:40.073234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:40.150947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 919/1840] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:40.169414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:40.223474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430fadc-5d9a-494f-bdcf-76582ec57e4b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:40.227326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:40.227967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:40.228247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:40.228516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:40.238725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:40.240308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a83bf-363b-409d-a818-8993525175a5 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:40.251211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 922/1841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:40.294603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:40.304001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cd30-656b-426c-97d1-6546ffc3076e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:40.307699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:40.308371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:40.308652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:40.308921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:40.365168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:40.366569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2453b-f8d0-48c3-9e01-27637e2e2e6d service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:40.375095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 920/1842] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:50.317002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:50.318114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:50.318715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:50.321393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 923/1843] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:39:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:39:50.341586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:50.342721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:50.343208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:50.375153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:50.379565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:50.502420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 921/1844] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:39:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:39:51.197413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:51.208578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:51.217972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2da75-8652-48df-a3eb-ebd17b2bb2b5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:51.223722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:51.224368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:51.224651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:51.224928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:51.234450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:51.236066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37445b-5e1e-4bee-bac9-10fb4aaa44e7 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:51.247163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 924/1845] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:58.740514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:58.908251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5800f-245d-4da1-97c5-e239db61972d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:58.914756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:58.919519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:58.919879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:58.920164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] PATH_INFO: `/v3/users/b8925bd259d1480191af590102ad878c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:58.921713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8925bd259d1480191af590102ad878c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:58.924104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:58.986724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8925bd259d1480191af590102ad878c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:58.987309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8925bd259d1480191af590102ad878c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.002698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8925bd259d1480191af590102ad878c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.013170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8925bd259d1480191af590102ad878c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.014639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8925bd259d1480191af590102ad878c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.035430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 922/1846] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:58 2022] DELETE /identity/v3/users/b8925bd259d1480191af590102ad878c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:59.036991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:59.037436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:59.037776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:59.057114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:39:59.058315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:59.143629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 925/1847] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:39:59.152572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:59.154500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:59.221964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d21a-ded0-401b-8bc9-9ad55c103d64 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:59.225459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:59.226126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:59.226401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:59.226667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:59.235959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:59.237362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:59.246314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 923/1848] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:39:59.508531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:59.510029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:39:59.522020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b9a1-bf59-4c7c-9d00-62c3c934527b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:59.526650 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:59.527531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:59.527816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:59.528671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] PATH_INFO: `/v3/projects/80a00152abc54da5959c7d9444dd9d2e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:59.529841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a00152abc54da5959c7d9444dd9d2e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:59.531780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:59.577719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a00152abc54da5959c7d9444dd9d2e', 'request_id': 'req-7298f097-e224-4f18-acb6-a0ab0e0c4414'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.584151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a00152abc54da5959c7d9444dd9d2e', 'request_id': 'req-7298f097-e224-4f18-acb6-a0ab0e0c4414'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.591289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a00152abc54da5959c7d9444dd9d2e', 'request_id': 'req-7298f097-e224-4f18-acb6-a0ab0e0c4414'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.603327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] The token cache is being invalidate because project 80a00152abc54da5959c7d9444dd9d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:39:59.603615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.604229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.605763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 926/1849] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:39:59 2022] DELETE /identity/v3/projects/80a00152abc54da5959c7d9444dd9d2e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:39:59.609685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:39:59.618785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5c19-f8a6-4b7d-9cb5-76301494735f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:39:59.674541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:39:59.675459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:39:59.675742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:39:59.676009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] PATH_INFO: `/v3/users/782f79ae37bf475ab1d8a5b386eb1b4d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:39:59.677187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782f79ae37bf475ab1d8a5b386eb1b4d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:39:59.679074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:39:59.724790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782f79ae37bf475ab1d8a5b386eb1b4d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.725447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782f79ae37bf475ab1d8a5b386eb1b4d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.739366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782f79ae37bf475ab1d8a5b386eb1b4d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.746765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782f79ae37bf475ab1d8a5b386eb1b4d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.747951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782f79ae37bf475ab1d8a5b386eb1b4d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:39:59.771382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 924/1850] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:39:59 2022] DELETE /identity/v3/users/782f79ae37bf475ab1d8a5b386eb1b4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:00.042154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:00.043692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:00.060278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f097-e224-4f18-acb6-a0ab0e0c4414 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:00.114671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:00.115551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.115826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.116095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] PATH_INFO: `/v3/projects/30aca388866a4d1dae00de7b07157f0b` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.117259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30aca388866a4d1dae00de7b07157f0b)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:00.119143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:00.166663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30aca388866a4d1dae00de7b07157f0b', 'request_id': 'req-dd9c2931-6846-434b-aa5b-e30563ae4bc9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.171962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30aca388866a4d1dae00de7b07157f0b', 'request_id': 'req-dd9c2931-6846-434b-aa5b-e30563ae4bc9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.178446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30aca388866a4d1dae00de7b07157f0b', 'request_id': 'req-dd9c2931-6846-434b-aa5b-e30563ae4bc9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.193761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] The token cache is being invalidate because project 30aca388866a4d1dae00de7b07157f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:00.194054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.194754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.196886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 927/1851] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:00 2022] DELETE /identity/v3/projects/30aca388866a4d1dae00de7b07157f0b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:00.201302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:00.202731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:00.221664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872877e-44ad-4b9b-91a9-3ecef2c5b233 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:00.285994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:00.287003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.287326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.287604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] PATH_INFO: `/v3/users/fd67c9a7e32d454bac919c607508196c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.288815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd67c9a7e32d454bac919c607508196c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:00.290767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:00.348795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd67c9a7e32d454bac919c607508196c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.349457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd67c9a7e32d454bac919c607508196c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.361807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd67c9a7e32d454bac919c607508196c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.368315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd67c9a7e32d454bac919c607508196c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.368977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5f275824-1f08-4610-bcc7-921051e78520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd67c9a7e32d454bac919c607508196c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.381649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 925/1852] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:00 2022] DELETE /identity/v3/users/fd67c9a7e32d454bac919c607508196c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:00.641395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:00.642820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:00.655923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c2931-6846-434b-aa5b-e30563ae4bc9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:00.712719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:00.713577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.713852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.714120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] PATH_INFO: `/v3/projects/7b90458004494ff8b06ee980dd63ea90` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.715767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b90458004494ff8b06ee980dd63ea90)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:00.717967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:00.761336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b90458004494ff8b06ee980dd63ea90', 'request_id': 'req-a47e4452-c726-4f1c-9b71-1007b7751007'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.766714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b90458004494ff8b06ee980dd63ea90', 'request_id': 'req-a47e4452-c726-4f1c-9b71-1007b7751007'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.772574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b90458004494ff8b06ee980dd63ea90', 'request_id': 'req-a47e4452-c726-4f1c-9b71-1007b7751007'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.784311 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] The token cache is being invalidate because project 7b90458004494ff8b06ee980dd63ea90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:00.784596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.785208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a47e4452-c726-4f1c-9b71-1007b7751007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:00.786729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 928/1853] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:00 2022] DELETE /identity/v3/projects/7b90458004494ff8b06ee980dd63ea90 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:00.792737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.793225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.793317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.811333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:00.812507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:00.869243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 926/1854] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:00.878819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.879107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.879439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.897908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:00.899564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:00.909521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 929/1855] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:00.913600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:00.923722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457f8a-2485-44b8-96ba-53ebe2a57ce3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:00.928256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:00.928932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.929208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.929473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.930191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:00.930494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:00.932088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:00.947405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 927/1856] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:00.949064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:00.959689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0dcdb-8317-4e4d-a9dd-fa017c139913 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:00.965000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:00.966663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:00.967309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:00.967646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:00.968434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:00.970414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:00.997995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 930/1857] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:00 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:01.002080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.012067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b0152-f80b-42a2-a67a-f7ccfd166977 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.075257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.075856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.076158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.076448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.077132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.079052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.104247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 928/1858] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:01 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:01.109248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.123440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f37cc-020d-477e-bd1f-035730ded5d4 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.128091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.128771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.129045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.129316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.130038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.131672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.143783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 931/1859] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:01.147924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.160077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef65a1-4d0a-4864-86c8-a1573152a1b7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.166016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.166798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.167145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.167504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.168330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.170046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648b0f-a8d6-40ae-a793-b6c2d6b12887 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.183888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 929/1860] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:01.185165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.195535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e3a35-f2b6-442f-b585-6f7a89e6e574 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.201073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.201897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.202173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.202443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] PATH_INFO: `/v3/projects/1a62d6a7062e4ccbaaa12d7cc4d53441/users/c0572fd3be7644ff853ca96318b3785d/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.218103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a62d6a7062e4ccbaaa12d7cc4d53441, user_id=c0572fd3be7644ff853ca96318b3785d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.220817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.234595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 932/1861] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:01 2022] PUT /identity/v3/projects/1a62d6a7062e4ccbaaa12d7cc4d53441/users/c0572fd3be7644ff853ca96318b3785d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:01.245775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.246177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.246581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.279162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] MFA Rules not processed for user `c0572fd3be7644ff853ca96318b3785d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:01.280495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:01.353055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 930/1862] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:01.357575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.448240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b050062-5eca-41ff-af0c-746f71d30d9e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.455197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.456089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.456386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.456752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.457656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.460243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.488724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 933/1863] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:01 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:01.492778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.504455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d671-911b-41b2-ad39-767e2142e2cb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.607462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.607462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.607462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.607462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.607822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.608940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.651451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 931/1864] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:01 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:01.655302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.667906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113572-b4a6-4c70-b376-1c3da6120be8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.674742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.676008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.676478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.676996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.678063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.681170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.711774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 934/1865] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:01.716512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.727302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7953-13ed-4c1f-89c5-2b50e5ff7841 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.732617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.733571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.733921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.734269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] PATH_INFO: `/v3/projects/c77cc03d57fe401495282906fb2f33c3/users/249f43f367ce42308877d370bf911281/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.749447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77cc03d57fe401495282906fb2f33c3, user_id=249f43f367ce42308877d370bf911281, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.752104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.765881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 932/1866] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:01 2022] PUT /identity/v3/projects/c77cc03d57fe401495282906fb2f33c3/users/249f43f367ce42308877d370bf911281/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:01.769688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.781015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd39f-0fee-4982-b4e0-c52ba37ee5ec admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.835924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.836608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.836889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.837163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.837891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.839545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb5393-8737-4eba-9b10-796714e204d6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.850099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 935/1867] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:01.854479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:01.865532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95175c5-cf7d-4994-85f2-1f23cf7e9bb2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:01.870283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:01.871259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.872389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.872731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] PATH_INFO: `/v3/projects/c77cc03d57fe401495282906fb2f33c3/users/249f43f367ce42308877d370bf911281/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.874833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77cc03d57fe401495282906fb2f33c3, user_id=249f43f367ce42308877d370bf911281, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:01.877598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:01.889382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 933/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:01 2022] PUT /identity/v3/projects/c77cc03d57fe401495282906fb2f33c3/users/249f43f367ce42308877d370bf911281/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:01.900884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:01.902232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:01.902508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:01.953403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] MFA Rules not processed for user `249f43f367ce42308877d370bf911281`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:01.954645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:02.029410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 936/1869] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:02.042920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:02.045607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:02.112537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce534-cb42-4f9c-b8db-cff7bbbe6e34 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:02.116711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:02.128767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:02.129131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:02.129418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:02.146003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:02.155879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:02.172784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 934/1870] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:02.261540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:02.270783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ec57a-57af-47a1-984c-385fb29f89d3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:02.274528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:02.275171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:02.275496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:02.275770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:02.469144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:02.470640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ace216-9054-4763-a93f-b935b1969535 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:02.480492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 937/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:03.383350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:03.385112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:03.478480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56543e4-0e94-44dd-95c8-393a1853f7ce service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:03.491219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:03.492147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:03.492425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:03.492702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] PATH_INFO: `/v3/users/67f6ca7b0d0441f1bad3f288a81a4dd3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:03.493948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f6ca7b0d0441f1bad3f288a81a4dd3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:03.496047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:03.549280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f6ca7b0d0441f1bad3f288a81a4dd3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:03.550323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f6ca7b0d0441f1bad3f288a81a4dd3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:03.564237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f6ca7b0d0441f1bad3f288a81a4dd3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:03.572506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f6ca7b0d0441f1bad3f288a81a4dd3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:03.573669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f6ca7b0d0441f1bad3f288a81a4dd3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:03.588452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 935/1872] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:03 2022] DELETE /identity/v3/users/67f6ca7b0d0441f1bad3f288a81a4dd3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:03.592896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:03.593376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:03.593557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:03.612041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:03.613328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:03.675502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 938/1873] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:03.685054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:03.686629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:03.742685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1a05-7f00-403e-81d2-111d54ae23de admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:03.746274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:03.746961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:03.747240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:03.747542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:03.756613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:03.758037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:03.767930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 936/1874] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:04.093090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:04.094520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:04.112531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89079-6798-41fe-ac06-bab99dff3647 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:04.118907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:04.119819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.120273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.120695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] PATH_INFO: `/v3/projects/c151aa2912654ab4a91373dca155ec62` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.122765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c151aa2912654ab4a91373dca155ec62)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:04.125569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:04.192328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c151aa2912654ab4a91373dca155ec62', 'request_id': 'req-a681a2a0-deab-4da8-8b33-9885e801bbb3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.199178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c151aa2912654ab4a91373dca155ec62', 'request_id': 'req-a681a2a0-deab-4da8-8b33-9885e801bbb3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.206755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c151aa2912654ab4a91373dca155ec62', 'request_id': 'req-a681a2a0-deab-4da8-8b33-9885e801bbb3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.219820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] The token cache is being invalidate because project c151aa2912654ab4a91373dca155ec62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:04.219998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.220623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.223562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 939/1875] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:04 2022] DELETE /identity/v3/projects/c151aa2912654ab4a91373dca155ec62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:04.226331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:04.236472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eefe97-86a4-4ab3-868f-9143243cccc5 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:04.292919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:04.293858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.294136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.294407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] PATH_INFO: `/v3/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.295647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5e7f0ae5ff4e0493e3f2ca41570b6a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:04.297570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:04.348873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5e7f0ae5ff4e0493e3f2ca41570b6a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.349526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5e7f0ae5ff4e0493e3f2ca41570b6a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.360548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5e7f0ae5ff4e0493e3f2ca41570b6a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.367049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5e7f0ae5ff4e0493e3f2ca41570b6a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.367697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8edf3f9a-dbf4-446a-b141-654fadddb3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5e7f0ae5ff4e0493e3f2ca41570b6a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.382051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 937/1876] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:04 2022] DELETE /identity/v3/users/3e5e7f0ae5ff4e0493e3f2ca41570b6a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:04.645159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:04.646710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:04.671403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681a2a0-deab-4da8-8b33-9885e801bbb3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:04.738108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:04.738987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.739289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.739572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] PATH_INFO: `/v3/projects/9da305b2fccc40ec9266385fe195ea51` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.740748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da305b2fccc40ec9266385fe195ea51)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:04.742639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:04.789391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da305b2fccc40ec9266385fe195ea51', 'request_id': 'req-c1dddaa2-a003-4328-b8da-c23878bf9d52'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.795177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da305b2fccc40ec9266385fe195ea51', 'request_id': 'req-c1dddaa2-a003-4328-b8da-c23878bf9d52'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.801936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da305b2fccc40ec9266385fe195ea51', 'request_id': 'req-c1dddaa2-a003-4328-b8da-c23878bf9d52'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.816335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] The token cache is being invalidate because project 9da305b2fccc40ec9266385fe195ea51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:04.816620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.817241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1dddaa2-a003-4328-b8da-c23878bf9d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:04.818784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 940/1877] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:04 2022] DELETE /identity/v3/projects/9da305b2fccc40ec9266385fe195ea51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:04.823992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.824497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.824621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.841739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:04.842954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:04.901080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 938/1878] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:04.909042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.909352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.909637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.927661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:04.928857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:04.937202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 941/1879] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:04.941388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:04.951153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246039-f8f0-4d49-9805-c86de7d946f7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:04.955755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:04.956411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.956694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.956966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.957683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:04.957987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:04.959601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:04.970656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 939/1880] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:04.974736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:04.984248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979e9d7-7b45-4454-ab2b-93f499aa0eb5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:04.988803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:04.989435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:04.989715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:04.989984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:04.990700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:04.992613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.017929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 942/1881] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:04 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:05.021829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.031451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e4c93-9315-4c2a-8f88-15f2a527918e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.085626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.086219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.086493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.086757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.087470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.089334 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.109092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 940/1882] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:05 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:05.113130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.123608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f0a0-939e-4002-9e77-9fed3abc413e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.128085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.128730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.129005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.129272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.129978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.131583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.141024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 943/1883] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:05.144748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.154990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7474ab-3267-4b95-adec-4e3aea190f5c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.159522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.160162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.160442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.160716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.161436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.163010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22710-7415-4a9d-8406-6ddb6d6e40df admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.175109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 941/1884] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:05.177653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.187900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e49a-f1e3-46ea-bc4a-743097bd2bd0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.192862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.193375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.193657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.194070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] PATH_INFO: `/v3/projects/c333da4c16294ca4a2b06da9d6b9551f/users/5e94364f23084d05ad8421076d926c61/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.209292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c333da4c16294ca4a2b06da9d6b9551f, user_id=5e94364f23084d05ad8421076d926c61, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.212287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.226917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 944/1885] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:05 2022] PUT /identity/v3/projects/c333da4c16294ca4a2b06da9d6b9551f/users/5e94364f23084d05ad8421076d926c61/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:05.239388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.239848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.240166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.267688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] MFA Rules not processed for user `5e94364f23084d05ad8421076d926c61`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:05.268974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:05.359330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 942/1886] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:05.371335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.500488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dd93e-52f6-4231-8d8b-54f06be32f77 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.505942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.506882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.507164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.507470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.508223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.510228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.552600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 945/1887] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:05 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:05.556588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.580488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd943f06-b1ec-4431-bbbb-75dfff92eccc None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.648177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.648996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.649349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.649711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.650506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.653696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.677006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 943/1888] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:05 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:05.680951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.694261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade52b0-31fa-4c60-a7e1-21abee2fe566 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.700188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.700869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.701205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.701398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.702120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.703735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.720770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 946/1889] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:05.726632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.740775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db4c7-756b-4e8a-8198-7a0527c019ac admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.748803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.749894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.750362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.750641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] PATH_INFO: `/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f/users/c5214f24839d453a85bff7a9a99b68e1/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.770582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c529d0b517d48bdaa06b5259a05cb5f, user_id=c5214f24839d453a85bff7a9a99b68e1, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.773270 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.795679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 944/1890] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:05 2022] PUT /identity/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f/users/c5214f24839d453a85bff7a9a99b68e1/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:05.799654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.815505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6bb26-3010-4ef1-baff-b344d229b028 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.881335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.882016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.882299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.882571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.883823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.885586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804a171-ce2a-4614-8f3a-d2c94014ce1d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.899361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 947/1891] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:05.903736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:05.914816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a020f8-085e-4575-aa5b-fadbfcc8ea4c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:05.924154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:05.925067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.925349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.925777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] PATH_INFO: `/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f/users/c5214f24839d453a85bff7a9a99b68e1/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.928196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c529d0b517d48bdaa06b5259a05cb5f, user_id=c5214f24839d453a85bff7a9a99b68e1, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:05.932181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:05.943299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 945/1892] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:05 2022] PUT /identity/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f/users/c5214f24839d453a85bff7a9a99b68e1/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:05.953945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:05.954238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:05.954491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:05.981866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] MFA Rules not processed for user `c5214f24839d453a85bff7a9a99b68e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:05.983109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:06.062219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 948/1893] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:06.075577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:06.077453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:06.143199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec741f7-035d-417a-a71d-9f8d0ecda58e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:06.146839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:06.147541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:06.147830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:06.148105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:06.159386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:06.160816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:06.171028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 946/1894] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:06.223354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:06.235948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4842c-02bb-44bf-b115-ff15ff9da681 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:06.239691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:06.240348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:06.240625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:06.240896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:06.313428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:06.315453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f34888-9d8e-407d-a14d-4e2c28b6e55d service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:06.326342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 949/1895] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:09.649785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:09.709898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7a47-292d-4da5-a5b3-32a9bfddacaf service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:09.714638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:09.716028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:09.716305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:09.716578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] PATH_INFO: `/v3/users/5e94364f23084d05ad8421076d926c61` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:09.717799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e94364f23084d05ad8421076d926c61)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:09.719757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:09.766215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e94364f23084d05ad8421076d926c61'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:09.766912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e94364f23084d05ad8421076d926c61'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:09.778868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e94364f23084d05ad8421076d926c61'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:09.785504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e94364f23084d05ad8421076d926c61'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:09.786085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e94364f23084d05ad8421076d926c61'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:09.798645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 947/1896] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:09 2022] DELETE /identity/v3/users/5e94364f23084d05ad8421076d926c61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:09.803059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:09.803580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:09.803670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:09.820105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:09.821298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:09.876918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 950/1897] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:09.886313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:09.887823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:09.942621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23ad7-2ebc-4bda-8f8b-e64c8c6a1927 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:09.946193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:09.946833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:09.947106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:09.947403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:09.956199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:09.957591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:09.967025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 948/1898] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:10.223915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:10.225344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:10.237018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a688c9b-5528-4424-a1ea-89d75d5cfb8d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:10.241687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:10.242548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:10.242825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:10.243097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] PATH_INFO: `/v3/projects/c333da4c16294ca4a2b06da9d6b9551f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:10.244323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c333da4c16294ca4a2b06da9d6b9551f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:10.246315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:10.300689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c333da4c16294ca4a2b06da9d6b9551f', 'request_id': 'req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.306682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c333da4c16294ca4a2b06da9d6b9551f', 'request_id': 'req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.312830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c333da4c16294ca4a2b06da9d6b9551f', 'request_id': 'req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.326177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] The token cache is being invalidate because project c333da4c16294ca4a2b06da9d6b9551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:10.326460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.327119 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.328687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 951/1899] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:10 2022] DELETE /identity/v3/projects/c333da4c16294ca4a2b06da9d6b9551f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:10.332659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:10.342509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef17cd-d7cb-420b-8acd-943ea7fe540c service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:10.400638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:10.401524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:10.401872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:10.402073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] PATH_INFO: `/v3/users/c5214f24839d453a85bff7a9a99b68e1` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:10.403770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5214f24839d453a85bff7a9a99b68e1)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:10.405248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:10.453339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5214f24839d453a85bff7a9a99b68e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.454008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5214f24839d453a85bff7a9a99b68e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.466741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5214f24839d453a85bff7a9a99b68e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.473964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5214f24839d453a85bff7a9a99b68e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.474653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-51786ef9-7ba3-4359-92dd-a3feb4c1f0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5214f24839d453a85bff7a9a99b68e1'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.487315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 949/1900] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:10 2022] DELETE /identity/v3/users/c5214f24839d453a85bff7a9a99b68e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:10.771035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:10.777271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:10.791509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df1ef3-0cc0-4eb6-84d2-fc6acecd27dd admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:10.846941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:10.847754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:10.848034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:10.848306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] PATH_INFO: `/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:10.849473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c529d0b517d48bdaa06b5259a05cb5f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:10.851424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:10.895233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c529d0b517d48bdaa06b5259a05cb5f', 'request_id': 'req-1cf86919-b763-4dc2-b441-c78b374fa44a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.900380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c529d0b517d48bdaa06b5259a05cb5f', 'request_id': 'req-1cf86919-b763-4dc2-b441-c78b374fa44a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.906130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c529d0b517d48bdaa06b5259a05cb5f', 'request_id': 'req-1cf86919-b763-4dc2-b441-c78b374fa44a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.917673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] The token cache is being invalidate because project 5c529d0b517d48bdaa06b5259a05cb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:10.917951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.919276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1cf86919-b763-4dc2-b441-c78b374fa44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:10.920963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 952/1901] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:10 2022] DELETE /identity/v3/projects/5c529d0b517d48bdaa06b5259a05cb5f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:10.925750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:10.926190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:10.926292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:10.944018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:10.945198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:11.001247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 950/1902] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:11.008906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.009191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.009467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.026853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:11.028090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:11.035750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 953/1903] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:11.039718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.049550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287f58-6f49-494a-b5ef-ca9209ab0ff8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.054320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.054960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.055237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.055545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.056351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:11.056654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.058352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.069951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 951/1904] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:11.074304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.083259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c02d0-87ce-4e16-917a-e1ae2a969c74 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.087887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.088540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.088821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.089093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.089771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.091729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.116511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 954/1905] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:11.120376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.130682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503ada9-c751-4630-aae6-a8fc79d8b89b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.185784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.186452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.186735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.187009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.187740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.189620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.208588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 952/1906] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:11.212577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.223150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c65b-c644-4356-a5ad-47c24cc335f4 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.227752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.228398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.228677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.228946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.229664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.231835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.241753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 955/1907] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:11.245328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.254898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82f2b-5e63-486c-856d-d2fd6fda98b7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.259583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.260257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.260534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.260805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.261514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.263116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f2819-7bda-4d76-b51b-0e219d111c44 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.272684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 953/1908] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:11.276421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.286632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462051-3b7c-4605-884e-15b984776db2 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.291129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.292042 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.292312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.292582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] PATH_INFO: `/v3/projects/2fbc391accaf44d5a4af1da1dbeb8023/users/d11f469095ea4a6587ce398f5478aa52/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.306857 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbc391accaf44d5a4af1da1dbeb8023, user_id=d11f469095ea4a6587ce398f5478aa52, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.309567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.321680 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 956/1909] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:11 2022] PUT /identity/v3/projects/2fbc391accaf44d5a4af1da1dbeb8023/users/d11f469095ea4a6587ce398f5478aa52/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:11.332854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.333172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.333446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.359948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] MFA Rules not processed for user `d11f469095ea4a6587ce398f5478aa52`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:11.361135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:11.422213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 954/1910] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:11.426671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.485990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d5e1-f456-4a5d-af6d-765d51184081 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.491424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.492017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.492291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.492560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.493244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.495280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.533876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 957/1911] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:11.535014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.545582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745d30-7b32-4532-bc68-7eeb5d8b36f4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.602122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.602822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.603097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.603420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.604109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.605994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.630939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 955/1912] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:11.636758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.656469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d823-fc2e-498c-b8f5-2c0bde508094 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.662063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.662824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.663340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.663490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.664489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.667767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.681074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 958/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:11.686535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.701111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71dd6-86d9-4a88-8d2c-62fc62fdd750 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.711170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.713031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.713320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.713603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.714330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.716668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40162-b3b0-4998-a534-890cc58cd07b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.730953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 956/1914] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:11.734893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.744518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4347fa-9979-43e2-be25-8aa113d501d0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.749943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.750903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.751258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.751648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] PATH_INFO: `/v3/projects/eb16d6b678894b4d99f78a8029071a93/users/b77b1af3cc26408e8c735c4604cffe32/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.766772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb16d6b678894b4d99f78a8029071a93, user_id=b77b1af3cc26408e8c735c4604cffe32, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.769563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.783640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 959/1915] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:11 2022] PUT /identity/v3/projects/eb16d6b678894b4d99f78a8029071a93/users/b77b1af3cc26408e8c735c4604cffe32/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:11.793795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.794105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.794427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.823007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] MFA Rules not processed for user `b77b1af3cc26408e8c735c4604cffe32`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:11.824188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:11.890075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 957/1916] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:11.894646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:11.965543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f8f6e-49e5-42c8-913c-ab06f13502b4 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:11.970339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:11.971007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:11.971291 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:11.971574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:11.972270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:11.974153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:11.999566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 960/1917] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:11 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:12.003754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.015297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e81bb-8f6a-42fe-9be3-c221b8ab0f98 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.071028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.071833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.072243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.073854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.075924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.078073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.105932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 958/1918] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:12 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:12.107393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.118016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a72-60db-41ea-8625-537d18662882 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.123652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.124447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.124827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.125216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.126322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.128413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.140668 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 961/1919] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:12.146667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.159230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273b36-7509-4b22-afa0-6c5749856b9a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.165014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.166096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.166396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.166658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] PATH_INFO: `/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2/users/6a31ef14640f4849a43ec3327a7904f9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.185609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dd605ae5244d1d9e1564e39e54f8d2, user_id=6a31ef14640f4849a43ec3327a7904f9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.188532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.203011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 959/1920] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:12 2022] PUT /identity/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2/users/6a31ef14640f4849a43ec3327a7904f9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:12.206836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.218748 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636762c-0a11-4bb7-90c1-2d781dd54b10 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.282990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.283690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.283975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.284885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.285893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.287609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4191e60-bf0c-450b-8b22-4b8a539568f6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.299604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 962/1921] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:12.303902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.315668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc91aa-98ac-41e8-b9c9-2a2b9452f0dc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.320358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.321249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.321518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.321792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] PATH_INFO: `/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2/users/6a31ef14640f4849a43ec3327a7904f9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.324040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dd605ae5244d1d9e1564e39e54f8d2, user_id=6a31ef14640f4849a43ec3327a7904f9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.326703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.337002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 960/1922] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:12 2022] PUT /identity/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2/users/6a31ef14640f4849a43ec3327a7904f9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:12.347016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.347430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.347833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.376425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] MFA Rules not processed for user `6a31ef14640f4849a43ec3327a7904f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:12.377720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:12.444437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 963/1923] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:12.455522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:12.457243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:12.512843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd29-4066-41b6-af18-4118c434ae72 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:12.516466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:12.517102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:12.517398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:12.517655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:12.526280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:12.527793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:12.536810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 961/1924] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:13.328072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:13.329596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:13.409847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d020-a593-4543-9492-2ab1c2d5c4fb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:13.415422 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:13.416549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:13.416936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:13.417505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] PATH_INFO: `/v3/users/c0572fd3be7644ff853ca96318b3785d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:13.420548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0572fd3be7644ff853ca96318b3785d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:13.422853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:13.498072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:13.499749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:13.503988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0572fd3be7644ff853ca96318b3785d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:13.504661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0572fd3be7644ff853ca96318b3785d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:13.513336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566753-b0af-4a82-9994-cfdf86a1840a service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:13.517665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:13.518316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:13.518595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:13.519045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:13.521170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:13.523049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0572fd3be7644ff853ca96318b3785d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:13.530838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0572fd3be7644ff853ca96318b3785d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:13.539869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-01b55202-1c4d-4ec3-abba-f5cc9e1d87c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0572fd3be7644ff853ca96318b3785d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:13.547674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 964/1925] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:13 2022] DELETE /identity/v3/users/c0572fd3be7644ff853ca96318b3785d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:13.552384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:13.552670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:13.552998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:13.572257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:13.574166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:13.589954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:13.591466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:13.600409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 962/1926] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:13.633840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 965/1927] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:13.644037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:13.645405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:13.700496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb217-4957-4173-ae88-6acfa0bc1871 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:13.750556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:13.751208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:13.752446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:13.752728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:13.764719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:13.766136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:13.775696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 963/1928] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:14.048839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:14.050198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:14.062480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777420f-ad86-48d5-8a44-b69efe265d5c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:14.067015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:14.068530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:14.068804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:14.069078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] PATH_INFO: `/v3/projects/1a62d6a7062e4ccbaaa12d7cc4d53441` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:14.070255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a62d6a7062e4ccbaaa12d7cc4d53441)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:14.072228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:14.130926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a62d6a7062e4ccbaaa12d7cc4d53441', 'request_id': 'req-4f00f087-b264-4b62-abde-baae99b44c8e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.136667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a62d6a7062e4ccbaaa12d7cc4d53441', 'request_id': 'req-4f00f087-b264-4b62-abde-baae99b44c8e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.146210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a62d6a7062e4ccbaaa12d7cc4d53441', 'request_id': 'req-4f00f087-b264-4b62-abde-baae99b44c8e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.163833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] The token cache is being invalidate because project 1a62d6a7062e4ccbaaa12d7cc4d53441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:14.164215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.165191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.171946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 966/1929] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:14 2022] DELETE /identity/v3/projects/1a62d6a7062e4ccbaaa12d7cc4d53441 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:14.173846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:14.192639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ab6d-83ad-4d60-9a10-8adc64504df9 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:14.249937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:14.250948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:14.251325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:14.251673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] PATH_INFO: `/v3/users/249f43f367ce42308877d370bf911281` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:14.253029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=249f43f367ce42308877d370bf911281)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:14.255009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:14.337155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249f43f367ce42308877d370bf911281'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.338781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249f43f367ce42308877d370bf911281'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.354091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249f43f367ce42308877d370bf911281'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.363281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249f43f367ce42308877d370bf911281'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.364134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c29b3269-b7ac-4f79-8d39-d7a1906752ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249f43f367ce42308877d370bf911281'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.382086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 964/1930] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:14 2022] DELETE /identity/v3/users/249f43f367ce42308877d370bf911281 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:14.785286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:14.785286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:14.798150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f087-b264-4b62-abde-baae99b44c8e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:14.868933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:14.869803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:14.870080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:14.871434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] PATH_INFO: `/v3/projects/c77cc03d57fe401495282906fb2f33c3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:14.872637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77cc03d57fe401495282906fb2f33c3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:14.874804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:14.931861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77cc03d57fe401495282906fb2f33c3', 'request_id': 'req-5caf8f24-af15-4c27-9989-d2aa69a91365'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.938854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77cc03d57fe401495282906fb2f33c3', 'request_id': 'req-5caf8f24-af15-4c27-9989-d2aa69a91365'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.945189 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77cc03d57fe401495282906fb2f33c3', 'request_id': 'req-5caf8f24-af15-4c27-9989-d2aa69a91365'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.967069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] The token cache is being invalidate because project c77cc03d57fe401495282906fb2f33c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:14.967069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.967069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5caf8f24-af15-4c27-9989-d2aa69a91365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:14.967540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 967/1931] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:14 2022] DELETE /identity/v3/projects/c77cc03d57fe401495282906fb2f33c3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:14.972129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:14.972613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:14.972693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:14.990462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:14.992323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:15.052983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 965/1932] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:15.060922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.061279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.061631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.081717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:15.083074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:15.091816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 968/1933] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:15.096073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.106215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1261f7-b693-4dc8-b734-c36be9eeae31 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.111239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.111999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.112344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.112623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.113341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:15.113650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.115232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.127444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 966/1934] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:15.131694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.141505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916501a-32bf-4858-82d3-a3308f7aa712 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.146154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.146794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.147078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.147380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.148104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.149994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.173738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 969/1935] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:15.178147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.188654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231e6c-de16-4e8c-a82b-da26c1c06a1b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.256195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.256879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.257161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.257434 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.258126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.260085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.290164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 967/1936] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:15.291257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.313436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974da202-4a40-42ec-a39f-7a5e6bee3e7c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.318971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.319738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.320120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.320414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.321131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.323002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.349950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 970/1937] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:15.354696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.367121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d24f01-305b-4856-8dfa-a79e274a6276 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.373137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.373842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.374120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.374393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.375174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.377022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43defb03-66e5-4e32-ae92-513abae408a5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.391009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 968/1938] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:15.395501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.410575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d2ad-2e6d-4519-a30f-b65feb587d9c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.415348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.416259 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.416538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.416805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] PATH_INFO: `/v3/projects/008617d83138436baa2d9cd32b1a9326/users/0f542f367b994423bd7f00a4633c142c/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.431768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=008617d83138436baa2d9cd32b1a9326, user_id=0f542f367b994423bd7f00a4633c142c, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.435078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.447349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 971/1939] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:15 2022] PUT /identity/v3/projects/008617d83138436baa2d9cd32b1a9326/users/0f542f367b994423bd7f00a4633c142c/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:15.458037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.458349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.458692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.489095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] MFA Rules not processed for user `0f542f367b994423bd7f00a4633c142c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:15.490607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:15.563425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 969/1940] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:15.567919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.640192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac35e4-ed25-4783-94eb-9c2aa203cd1d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.647972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.648650 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.648932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.649210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.649915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.651877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.687105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 972/1941] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:15.691672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.703871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fe623-7f7f-467b-af62-ee6aade328b1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.771199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.771944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.772231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.773919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.773919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.775163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.800644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 970/1942] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:15 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:15.804255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.820284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961441a-f502-4d6f-bb11-deacb07630fe admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.826415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.827406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.827772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.828152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.828977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.830784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.846207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 973/1943] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:15.850219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.861217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44626a4-9b23-42bc-8ba6-bfe025f316c5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.863425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.865284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:15.866014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.866919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.867202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.867519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] PATH_INFO: `/v3/projects/092237d35c8947279615fb857e3c6b33/users/ba3f63163ba74e07a93878520062de7f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.883206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331af203-9f03-4eae-99cc-ada55531f4bb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.883450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092237d35c8947279615fb857e3c6b33, user_id=ba3f63163ba74e07a93878520062de7f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.885925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.888942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.889815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.890093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.890403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] PATH_INFO: `/v3/users/6bcf870ca89247289af7fed28395222f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.891872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bcf870ca89247289af7fed28395222f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.894006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.910422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 971/1944] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:15 2022] PUT /identity/v3/projects/092237d35c8947279615fb857e3c6b33/users/ba3f63163ba74e07a93878520062de7f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:15.914177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:15.953964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bcf870ca89247289af7fed28395222f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:15.957807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bcf870ca89247289af7fed28395222f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:15.972924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bcf870ca89247289af7fed28395222f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:15.979937 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1932e3-4997-4e70-8a4e-196985e5e685 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:15.982986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bcf870ca89247289af7fed28395222f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:15.986536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:15.987324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:15.987820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:15.988284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:15.989246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:15.991872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:15.992708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6773f7f2-5324-49a8-8a47-63b1af683983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bcf870ca89247289af7fed28395222f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:16.002220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 974/1945] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:15 2022] DELETE /identity/v3/users/6bcf870ca89247289af7fed28395222f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:16.006870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:16.007160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:16.007549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:16.010097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 972/1946] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:16.015666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:16.017462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.027938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:16.029500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.030241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea4233-b01e-4570-ab10-a427c2224915 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:16.096946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:16.097847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:16.098129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:16.098571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] PATH_INFO: `/v3/projects/092237d35c8947279615fb857e3c6b33/users/ba3f63163ba74e07a93878520062de7f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:16.100972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] RBAC: Authorizing `identity:create_grant(project_id=092237d35c8947279615fb857e3c6b33, user_id=ba3f63163ba74e07a93878520062de7f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:16.110876 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1a61-f8a2-43e7-ae46-5abe7060403f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:16.111066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 975/1947] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:16.115986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:16.117557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 973/1948] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:16 2022] PUT /identity/v3/projects/092237d35c8947279615fb857e3c6b33/users/ba3f63163ba74e07a93878520062de7f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:16.117697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.130860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:16.131385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:16.131809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:16.170262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] MFA Rules not processed for user `ba3f63163ba74e07a93878520062de7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:16.172441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.227408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f2f67-09d0-4278-86b4-534daf23cc26 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:16.285427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 974/1949] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:16.300765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:16.301418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:16.301704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:16.302058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:16.341644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:16.344562 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.381076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:16.383610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:16.394706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 976/1950] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:16.457797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6026b-f121-4499-bc7b-17aecfece565 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:16.467062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:16.468805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:16.469180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:16.470419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:16.476904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:16.566288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:16.568355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:16.589441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 975/1951] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:17.058622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.060467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.073558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648f99f-810a-4c68-9be3-5ad27a49c21d service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.079356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.080424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.080710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.080978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] PATH_INFO: `/v3/projects/9749a39b055f44f897aee3e4a38a8e80` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.082163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9749a39b055f44f897aee3e4a38a8e80)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:17.084100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:17.148807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9749a39b055f44f897aee3e4a38a8e80', 'request_id': 'req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.150269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.151837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.155121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9749a39b055f44f897aee3e4a38a8e80', 'request_id': 'req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.163643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9749a39b055f44f897aee3e4a38a8e80', 'request_id': 'req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.167717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62849ba-09b0-4c61-9ea1-ce81663e58c7 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.179147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] The token cache is being invalidate because project 9749a39b055f44f897aee3e4a38a8e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:17.179455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.180086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.182198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 977/1952] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:17 2022] DELETE /identity/v3/projects/9749a39b055f44f897aee3e4a38a8e80 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:17.186492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.188066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.233809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.234677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.234951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.235212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] PATH_INFO: `/v3/users/143d2f49862c43a5a700c282ed8808d3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.236411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143d2f49862c43a5a700c282ed8808d3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:17.238296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:17.263850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ee35-4054-42e5-8cfb-e9ba3ededaad admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.268925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.269812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.270116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.270430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] PATH_INFO: `/v3/users/aa038b95e7f84ad293040d4dbfb1ca4f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.271674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa038b95e7f84ad293040d4dbfb1ca4f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:17.273578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:17.281927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143d2f49862c43a5a700c282ed8808d3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.282589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143d2f49862c43a5a700c282ed8808d3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.294489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143d2f49862c43a5a700c282ed8808d3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.302367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143d2f49862c43a5a700c282ed8808d3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.303175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a542b36a-7a35-4e91-bb1a-d05d4f83fdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143d2f49862c43a5a700c282ed8808d3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.316490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 976/1953] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:17 2022] DELETE /identity/v3/users/143d2f49862c43a5a700c282ed8808d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:17.320946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.321235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.321511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.321912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa038b95e7f84ad293040d4dbfb1ca4f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.322598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa038b95e7f84ad293040d4dbfb1ca4f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.335341 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa038b95e7f84ad293040d4dbfb1ca4f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.338453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:17.339693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.341973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa038b95e7f84ad293040d4dbfb1ca4f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.349131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa038b95e7f84ad293040d4dbfb1ca4f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.355059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 978/1954] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:17 2022] DELETE /identity/v3/users/aa038b95e7f84ad293040d4dbfb1ca4f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:17.399924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 977/1955] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:17.409728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.411232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.478742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb4ca9-0f1c-4796-89c1-9f4a94e2d916 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.482866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.483559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.483833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.484171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.548732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:17.550344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:17.561244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 979/1956] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:17.741153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.742949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.764696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4220-68c3-4dce-a6ab-439c9d3cb4f0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.769873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.770806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.771088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.771395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] PATH_INFO: `/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.772903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79503c66e4a245fabd4f1fd73b55bfd5)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:17.775170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:17.836835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79503c66e4a245fabd4f1fd73b55bfd5', 'request_id': 'req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.845036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:17.846453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.853657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79503c66e4a245fabd4f1fd73b55bfd5', 'request_id': 'req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.859996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79503c66e4a245fabd4f1fd73b55bfd5', 'request_id': 'req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.872594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] The token cache is being invalidate because project 79503c66e4a245fabd4f1fd73b55bfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:17.872880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.873530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4170f4f5-ce7c-4c8f-8967-d3abeb94b002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:17.875296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 978/1957] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:17 2022] DELETE /identity/v3/projects/79503c66e4a245fabd4f1fd73b55bfd5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:17.879894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a034bb-f189-4724-a6ed-e5a289209f37 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.880185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a034bb-f189-4724-a6ed-e5a289209f37 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.880510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a034bb-f189-4724-a6ed-e5a289209f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.911170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-17a034bb-f189-4724-a6ed-e5a289209f37 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:17.912509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17a034bb-f189-4724-a6ed-e5a289209f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.923444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9458063-3a12-4ebf-82c9-4c9524494116 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:17.974503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:17.975627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.976068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.976345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:17.977015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 979/1958] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:17.979099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:17.985694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:17.986023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:17.986456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.006252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:18.007724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.035027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 980/1959] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:18.036791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.038564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.051131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf941b8-577b-4129-bee7-2907e9eb9b86 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.056360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.057216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.057626 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.057909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] PATH_INFO: `/v3/projects/9a84fb213e6045e7a3f1c7adf1a16b22` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.059170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a84fb213e6045e7a3f1c7adf1a16b22)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.069570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.069676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.069676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.075965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 980/1960] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:18.076948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.089072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1222-1980-4343-9e9a-46e8eb56e098 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.095057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.095825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.097148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.097436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.098167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:18.098901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.100692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.118568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 981/1961] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:18.119629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.127368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a84fb213e6045e7a3f1c7adf1a16b22', 'request_id': 'req-4ccd1f18-662f-4f10-8531-f7a0fd72944c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.130265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673af8-61a3-41fb-a8a7-4a1d58c60ffe admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.136388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a84fb213e6045e7a3f1c7adf1a16b22', 'request_id': 'req-4ccd1f18-662f-4f10-8531-f7a0fd72944c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.144465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a84fb213e6045e7a3f1c7adf1a16b22', 'request_id': 'req-4ccd1f18-662f-4f10-8531-f7a0fd72944c'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.156775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] The token cache is being invalidate because project 9a84fb213e6045e7a3f1c7adf1a16b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:18.157343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.157773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.159830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 981/1962] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:18 2022] DELETE /identity/v3/projects/9a84fb213e6045e7a3f1c7adf1a16b22 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:18.163432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.165227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.220357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.221010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.221296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.221575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.222316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.225752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.261151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 982/1963] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:18 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:18.265814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.269655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.271211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd1f18-662f-4f10-8531-f7a0fd72944c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.386819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.392682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.393296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.394709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] PATH_INFO: `/v3/users/e17c3c61c23943a1bf79852e11a3fa22` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.398466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17c3c61c23943a1bf79852e11a3fa22)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.401651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8504b7-9029-478b-84aa-1932e112114d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.413527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.415658 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.416559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.417166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.417623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.418715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.421579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.481409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 983/1964] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:18 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:18.485815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.523210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf28a-33f1-489b-9c62-e425fca0f60b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.540681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17c3c61c23943a1bf79852e11a3fa22'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.541780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17c3c61c23943a1bf79852e11a3fa22'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.542793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.543632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.543995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.544276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.545113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.546884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.564731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17c3c61c23943a1bf79852e11a3fa22'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.575716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17c3c61c23943a1bf79852e11a3fa22'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.576639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17c3c61c23943a1bf79852e11a3fa22'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:18.589036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 984/1965] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:18.600964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.602934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.606972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 982/1966] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:18 2022] DELETE /identity/v3/users/e17c3c61c23943a1bf79852e11a3fa22 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:18.630400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd8803-f5ce-47a7-9b86-834bd4310726 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.721601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.722350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.722663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.722991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.723892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.725996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b664-3ee0-4a3f-9a35-23f09d4313e1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.738083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 985/1967] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:18.742663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.755367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96536cc-4a83-4b68-b185-0e20c90c2bd8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:18.764187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:18.765094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.765371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.765638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] PATH_INFO: `/v3/projects/dc58d7896d904e3d8f02c28b1e225b85/users/80f5d755374c4464a2436c456260b2ee/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.796243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc58d7896d904e3d8f02c28b1e225b85, user_id=80f5d755374c4464a2436c456260b2ee, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:18.801412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:18.819318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 983/1968] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:18 2022] PUT /identity/v3/projects/dc58d7896d904e3d8f02c28b1e225b85/users/80f5d755374c4464a2436c456260b2ee/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:18.829531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:18.829815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:18.830093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:18.862801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] MFA Rules not processed for user `80f5d755374c4464a2436c456260b2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:18.864076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.928820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:18.931062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:18.955226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 986/1969] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:18.959220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.041721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6005b7-be4c-4250-87f5-9c615a8300a4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.051407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.052131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.052560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.052837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.053528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.055498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.056852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17043b41-48df-409d-80a6-c7f086e94a32 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.062963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.063882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.064167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.064444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] PATH_INFO: `/v3/projects/5c2e98218fa44077b1146873e42e75a3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.067070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2e98218fa44077b1146873e42e75a3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.069033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.097609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 987/1970] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:18 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:19.101549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.126459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2e98218fa44077b1146873e42e75a3', 'request_id': 'req-0aa384fb-7e58-4410-a612-3a3cb0088b93'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:19.136723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2e98218fa44077b1146873e42e75a3', 'request_id': 'req-0aa384fb-7e58-4410-a612-3a3cb0088b93'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:19.142996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2e98218fa44077b1146873e42e75a3', 'request_id': 'req-0aa384fb-7e58-4410-a612-3a3cb0088b93'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:19.155257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] The token cache is being invalidate because project 5c2e98218fa44077b1146873e42e75a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:19.155670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:19.156663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0aa384fb-7e58-4410-a612-3a3cb0088b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:19.158262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 984/1971] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:18 2022] DELETE /identity/v3/projects/5c2e98218fa44077b1146873e42e75a3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:19.163165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e154298-0197-499e-8acd-7e009b93cdd1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.163480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e154298-0197-499e-8acd-7e009b93cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.163760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e154298-0197-499e-8acd-7e009b93cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.174023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e838-faac-434d-9a20-a60bb1a1f117 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.184607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2e154298-0197-499e-8acd-7e009b93cdd1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:19.186012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2e154298-0197-499e-8acd-7e009b93cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.238607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.239313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.239604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.239878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.240567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.242473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.251012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 985/1972] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:19.260314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.261013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.261359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.266820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 988/1973] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:19.268092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.269652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.281638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e974c9-ecbf-42f8-91ac-0554c5bd537c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.283127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:19.284387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.287356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.288346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.289048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.289480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.290280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.292251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.292800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 986/1974] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:19.298981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.307567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee34f2-9aa0-42a0-ac66-42c750b9dc30 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.311431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 989/1975] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:19.313483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.316324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.317109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.317447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.317789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.318641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:19.318953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.321007 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.324014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9fd97-03dc-4110-a497-e311e65e5e5f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.328365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.329228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.329552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.330105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] PATH_INFO: `/v3/projects/972006e839a54f3c85b973a6cc19f84b/users/9c7787de1e58454e8f54e1f544d2b746/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.336491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 987/1976] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:19.337759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.346170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972006e839a54f3c85b973a6cc19f84b, user_id=9c7787de1e58454e8f54e1f544d2b746, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.348667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de750-1aff-4762-920a-17f1047bd5ca admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.348865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.354349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.355345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.356377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.356750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.357676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.359750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.364689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 990/1977] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:19 2022] PUT /identity/v3/projects/972006e839a54f3c85b973a6cc19f84b/users/9c7787de1e58454e8f54e1f544d2b746/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:19.368381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.392301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 988/1978] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:19.396231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.456503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5065-bd31-4a3e-bbc3-3c2dcc4c78b8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.466736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacbfc3-c639-4af5-bf0e-59e1d1b4b821 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.471382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.472053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.472330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.472601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.473733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.475210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.499921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 989/1979] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:19.500882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.512485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83323c5-821b-45af-a3cc-e58bb5d286de admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.517445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.518112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.518396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.518676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.519606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.519723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.520495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.520871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.521244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.521353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.522091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.523808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.532471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 990/1980] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:19.536346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.539465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 991/1981] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:19.541369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.547389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17efbdf-2384-4ecd-bcdc-af7ee394888e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.552284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.552637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9ca2-1ad0-4cd5-8b3f-9b58b356f24f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.553164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.553541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.553871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.554670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.556375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.557754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.558782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.559056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.559442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] PATH_INFO: `/v3/projects/972006e839a54f3c85b973a6cc19f84b/users/9c7787de1e58454e8f54e1f544d2b746/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.561496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972006e839a54f3c85b973a6cc19f84b, user_id=9c7787de1e58454e8f54e1f544d2b746, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.564242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389da9fe-e864-4f7d-b894-5acbf824f4c0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.569483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 991/1982] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:19.574985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.575448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 992/1983] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:19 2022] PUT /identity/v3/projects/972006e839a54f3c85b973a6cc19f84b/users/9c7787de1e58454e8f54e1f544d2b746/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:19.585933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.586308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.586664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.596020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1db26-8c55-4b18-a65c-bd89ffd2d28c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.626457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] MFA Rules not processed for user `9c7787de1e58454e8f54e1f544d2b746`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:19.627722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.725855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 993/1984] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:19.746610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.747600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.747885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.748168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] PATH_INFO: `/v3/projects/872ecad8671e4cc8a6d8e6732a1d5d93/users/46e5da390e954a00a81b158fbc27768f/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.765552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872ecad8671e4cc8a6d8e6732a1d5d93, user_id=46e5da390e954a00a81b158fbc27768f, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:19.778511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c8fd2-cb4d-4663-b894-dabe688e6b36 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:19.778592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.779591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.794056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 992/1985] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:19 2022] PUT /identity/v3/projects/872ecad8671e4cc8a6d8e6732a1d5d93/users/46e5da390e954a00a81b158fbc27768f/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:19.805150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.805333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.805661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.846557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] MFA Rules not processed for user `46e5da390e954a00a81b158fbc27768f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:19.849041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:19.859380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fbdfc-4771-472d-af54-43ddad4094db None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:19.918319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:19.918973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:19.919252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:19.919582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:19.928788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 993/1986] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:19.933753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:19.999733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.001278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.013161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 994/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:20.033874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5eaf1-fcd9-4ac8-aec5-f89d3cb37fa8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.038788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.039553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.039877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.040107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.040802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.042706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.070398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 994/1988] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:19 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:20.075337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.087724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ed98-23d1-49b8-b479-986f8019061a service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.146531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.147201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.147520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.147781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.148490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.150453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.177990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 995/1989] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:20 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:20.183208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.195958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03122-1f9e-4337-b8d1-42b916cba594 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.201980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.202660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.203029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.203340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.204121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.205736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.220170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.222198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:20.222718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 995/1990] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:20.226845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.238704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0a971-f085-434c-a101-af935892be13 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.243677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.244563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.244846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.245119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] PATH_INFO: `/v3/projects/e6db266673c742b1ad26070506ed614e/users/44cadb92a0b4480486bafba6844ab463/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.263373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6db266673c742b1ad26070506ed614e, user_id=44cadb92a0b4480486bafba6844ab463, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.266295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.282020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 996/1991] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:20 2022] PUT /identity/v3/projects/e6db266673c742b1ad26070506ed614e/users/44cadb92a0b4480486bafba6844ab463/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:20.286899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.309476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31eb5ff-0c29-4af3-be5c-1353cd5e993d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.372519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0df01-533f-447b-9900-4205b14cafce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.377721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.377853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.378566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.378695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.378976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.379074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.379406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.379532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.380371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.381567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:20.382112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.410827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 997/1992] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:20.415241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.425597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ebe8a-3836-4af9-9adf-fe2376cc34f6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.430299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.431194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.431501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.431772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] PATH_INFO: `/v3/projects/e6db266673c742b1ad26070506ed614e/users/44cadb92a0b4480486bafba6844ab463/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.434640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6db266673c742b1ad26070506ed614e, user_id=44cadb92a0b4480486bafba6844ab463, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.437187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4b0c-ad69-4994-8d7e-3163f03b4e35 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.447546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 998/1993] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:20 2022] PUT /identity/v3/projects/e6db266673c742b1ad26070506ed614e/users/44cadb92a0b4480486bafba6844ab463/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:20.454988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.456472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.462183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.462751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.463017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.467136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 996/1994] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:20.492091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] MFA Rules not processed for user `44cadb92a0b4480486bafba6844ab463`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:20.493353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:20.584839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 999/1995] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:20.616890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.626322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931105a9-8fb5-417f-8767-facd6569d3a1 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.680014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.680725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.681104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.681482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.693649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.695100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.706425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 997/1996] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:20.740725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.742098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:20.761596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:20.771069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0af66-fd02-42dd-833e-86de8e405d58 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.780639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.781922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.782359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.783604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.830113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6fdb-6105-4893-a828-bd30e1ba0d51 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:20.834779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:20.835696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.835974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.836242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] PATH_INFO: `/v3/users/d11f469095ea4a6587ce398f5478aa52` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.837440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11f469095ea4a6587ce398f5478aa52)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.839430 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.851520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:20.853604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5689a-d699-4bbb-8f49-e89f160dc180 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:20.867324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 998/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:20.899233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11f469095ea4a6587ce398f5478aa52'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:20.900189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11f469095ea4a6587ce398f5478aa52'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:20.923310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11f469095ea4a6587ce398f5478aa52'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:20.933480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11f469095ea4a6587ce398f5478aa52'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:20.934172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11f469095ea4a6587ce398f5478aa52'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:20.952039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1000/1998] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:20 2022] DELETE /identity/v3/users/d11f469095ea4a6587ce398f5478aa52 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:20.956592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:20.956910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:20.957198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:20.976584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:20.977793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:21.052916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 999/1999] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:21.060365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:21.062149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:21.139911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd21c91-1dc7-44ec-a6bc-6b69c6e9e409 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:21.144818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:21.145733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:21.146173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:21.146519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:21.172547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:21.174406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:21.192469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1001/2000] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:21.499999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:21.501434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:21.557182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf562df-1ebc-44da-bfe2-47fced54e70d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:21.560792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:21.561433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:21.561714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:21.561989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:21.563772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:21.633000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:21.635817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:21.650185 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1000/2001] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:21.762822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:21.764488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:21.792454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b60502-dcf5-47fa-9639-63f2f853f65f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:21.807678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:21.809911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:21.810202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:21.810477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] PATH_INFO: `/v3/projects/2fbc391accaf44d5a4af1da1dbeb8023` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:21.814911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbc391accaf44d5a4af1da1dbeb8023)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:21.817792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:21.919897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbc391accaf44d5a4af1da1dbeb8023', 'request_id': 'req-3f914924-c569-4d30-927d-e49db34ae201'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:21.932942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbc391accaf44d5a4af1da1dbeb8023', 'request_id': 'req-3f914924-c569-4d30-927d-e49db34ae201'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:21.939779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbc391accaf44d5a4af1da1dbeb8023', 'request_id': 'req-3f914924-c569-4d30-927d-e49db34ae201'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:21.953760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] The token cache is being invalidate because project 2fbc391accaf44d5a4af1da1dbeb8023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:21.954204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:21.954977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:21.957098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1002/2002] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:21 2022] DELETE /identity/v3/projects/2fbc391accaf44d5a4af1da1dbeb8023 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:21.961128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:21.983687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a98ba8-8fae-4f24-ba17-e8428b4dcfd1 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:22.132853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:22.133743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:22.134017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:22.134978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] PATH_INFO: `/v3/users/b77b1af3cc26408e8c735c4604cffe32` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:22.136224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77b1af3cc26408e8c735c4604cffe32)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:22.138209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:22.211073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77b1af3cc26408e8c735c4604cffe32'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:22.212515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77b1af3cc26408e8c735c4604cffe32'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:22.235712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77b1af3cc26408e8c735c4604cffe32'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:22.254190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77b1af3cc26408e8c735c4604cffe32'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:22.266287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77b1af3cc26408e8c735c4604cffe32'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:22.274402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1001/2003] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:21 2022] DELETE /identity/v3/users/b77b1af3cc26408e8c735c4604cffe32 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:22.873820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:22.875812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:22.889190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f914924-c569-4d30-927d-e49db34ae201 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:22.952174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:22.953356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:22.953639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:22.953911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] PATH_INFO: `/v3/projects/eb16d6b678894b4d99f78a8029071a93` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:22.955471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb16d6b678894b4d99f78a8029071a93)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:22.957373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:23.013610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb16d6b678894b4d99f78a8029071a93', 'request_id': 'req-a38277a8-62a3-4785-9cab-de42d97eef9f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.021386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb16d6b678894b4d99f78a8029071a93', 'request_id': 'req-a38277a8-62a3-4785-9cab-de42d97eef9f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.027390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb16d6b678894b4d99f78a8029071a93', 'request_id': 'req-a38277a8-62a3-4785-9cab-de42d97eef9f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.040811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] The token cache is being invalidate because project eb16d6b678894b4d99f78a8029071a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:23.041308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.043252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.045644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1003/2004] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:22 2022] DELETE /identity/v3/projects/eb16d6b678894b4d99f78a8029071a93 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:23.049393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:23.051048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:23.073355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77deeca-ca07-4fb2-aeb6-f6153c491591 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:23.214144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:23.215090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:23.215409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:23.215685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] PATH_INFO: `/v3/users/6a31ef14640f4849a43ec3327a7904f9` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:23.219090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a31ef14640f4849a43ec3327a7904f9)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:23.223664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:23.299548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a31ef14640f4849a43ec3327a7904f9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.300264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a31ef14640f4849a43ec3327a7904f9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.314836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a31ef14640f4849a43ec3327a7904f9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.321983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a31ef14640f4849a43ec3327a7904f9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.334588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5a1d0bd1-ec44-4207-923b-68a8e909cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a31ef14640f4849a43ec3327a7904f9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.341795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1002/2005] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:23 2022] DELETE /identity/v3/users/6a31ef14640f4849a43ec3327a7904f9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:23.669218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:23.670886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:23.688941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38277a8-62a3-4785-9cab-de42d97eef9f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:23.798121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:23.799116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:23.799500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:23.799846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] PATH_INFO: `/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:23.801160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=95dd605ae5244d1d9e1564e39e54f8d2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:23.803153 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:23.869708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95dd605ae5244d1d9e1564e39e54f8d2', 'request_id': 'req-0b3030db-996d-43eb-a8cd-f38edc1b18eb'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.886564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95dd605ae5244d1d9e1564e39e54f8d2', 'request_id': 'req-0b3030db-996d-43eb-a8cd-f38edc1b18eb'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.894110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95dd605ae5244d1d9e1564e39e54f8d2', 'request_id': 'req-0b3030db-996d-43eb-a8cd-f38edc1b18eb'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.906218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] The token cache is being invalidate because project 95dd605ae5244d1d9e1564e39e54f8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:23.906516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.907245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0b3030db-996d-43eb-a8cd-f38edc1b18eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:23.909183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1004/2006] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:23 2022] DELETE /identity/v3/projects/95dd605ae5244d1d9e1564e39e54f8d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:23.915252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:23.916351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:23.916351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:23.934481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:23.935790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:24.050469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1003/2007] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:24.058097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.058461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.058884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.079540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:24.080883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:24.090709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1005/2008] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:24.095222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.107557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c6cb-b71d-4155-bc8c-5dc6d8258418 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.113500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.114173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.114452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.114720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.115568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:24.117007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.118855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.138180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1004/2009] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:24.138820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.148726 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c371-bb3f-438a-a3b7-daa0622ab791 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.154530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.155581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.155966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.156245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.156955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.159251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.192831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1006/2010] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:24.197949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.209153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eafff-dfc7-4119-a691-dc06ee5c2116 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.295996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.296779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.297267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.297755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.298632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.315316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.360420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1005/2011] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:24.361617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.376502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea948-19db-487b-8c74-c8ed8a13a084 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.388132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.388894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.389340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.389881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.391774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.395793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.421456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1007/2012] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:24.434572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.446476 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a91be-82f9-49ae-834a-f4315d18c94f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.453623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.454853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.455808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.457006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.458494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.460614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0cb4-28b7-4fa6-8902-8767f44fa8ce admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.474080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1006/2013] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:24.478455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.493201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84546cf8-0b5b-4469-a58f-c3ccaab98db4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.505662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.506575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.506855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.507129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] PATH_INFO: `/v3/projects/d00025caa4dc487d8071c803e57e9145/users/1fbc1a8598f5491cb3c76897f93d4678/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.535596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00025caa4dc487d8071c803e57e9145, user_id=1fbc1a8598f5491cb3c76897f93d4678, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.538595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.587975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1008/2014] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:24 2022] PUT /identity/v3/projects/d00025caa4dc487d8071c803e57e9145/users/1fbc1a8598f5491cb3c76897f93d4678/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:24.600336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.600839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.601348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.646157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.648828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:24.674560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] MFA Rules not processed for user `1fbc1a8598f5491cb3c76897f93d4678`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:24.677428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:24.826133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445b6d7-da8c-41cf-a9e4-4e0967ee8cfb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.841018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1007/2015] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:24.846873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.847212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.848355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.849345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.850201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] PATH_INFO: `/v3/users/46e5da390e954a00a81b158fbc27768f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.853167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e5da390e954a00a81b158fbc27768f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.858840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.868492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb79c-3bf8-43d8-895e-dff32f66c24c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:24.878370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:24.879041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:24.879351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:24.879607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:24.880296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:24.883989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:24.955106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1008/2016] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:24.959364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:24.961935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e5da390e954a00a81b158fbc27768f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:24.964771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e5da390e954a00a81b158fbc27768f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:24.998695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e5da390e954a00a81b158fbc27768f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:25.020128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e5da390e954a00a81b158fbc27768f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:25.021263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-fe48461f-7bfb-470f-b4e1-7c94c06915cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e5da390e954a00a81b158fbc27768f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:25.041316 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1009/2017] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:24 2022] DELETE /identity/v3/users/46e5da390e954a00a81b158fbc27768f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:25.045685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.046046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.046299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ed6f-0df4-4078-a062-5f188ab086d9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.046452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.072286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:25.076207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.114660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.116469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.116834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.117213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.118074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.120367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.148789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1009/2018] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:24 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:25.150056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.152127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.172092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4157b9-107e-48c3-b414-0f8a02c8f264 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.181505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1010/2019] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:25.181720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.182370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.182784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.183061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.184028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.185632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.196258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.201507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.216902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1010/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:25.219896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.244229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8099e-0905-4217-bd52-a8d67383ce87 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.249895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.250956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.251299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.251597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] PATH_INFO: `/v3/projects/8011f40e920040688ec08a55418b8cbc/users/269f647eaf924f01a467daeba2c1adf9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.269265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8011f40e920040688ec08a55418b8cbc, user_id=269f647eaf924f01a467daeba2c1adf9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.273052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.292498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1106888-2f32-456e-af96-c81d446bbb99 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.297845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1011/2021] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:25 2022] PUT /identity/v3/projects/8011f40e920040688ec08a55418b8cbc/users/269f647eaf924f01a467daeba2c1adf9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:25.301365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.382511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.383169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.383475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.383748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.398915 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb4b1-3195-41bc-b345-6d43db5efc94 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.405106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.405791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.406073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.406412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.409432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.411558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.428269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1012/2022] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:25.432774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.449062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86f498-b657-4b7a-ae53-a052768eceed admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.456707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.457632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.457910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.458229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] PATH_INFO: `/v3/projects/8011f40e920040688ec08a55418b8cbc/users/269f647eaf924f01a467daeba2c1adf9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.460634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8011f40e920040688ec08a55418b8cbc, user_id=269f647eaf924f01a467daeba2c1adf9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.463689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbdcce-bad4-4923-87a6-926e2f4174b9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.475565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1013/2023] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:25 2022] PUT /identity/v3/projects/8011f40e920040688ec08a55418b8cbc/users/269f647eaf924f01a467daeba2c1adf9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:25.478529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.480820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.486588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.486942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.487319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.500273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1011/2024] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:25.528441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] MFA Rules not processed for user `269f647eaf924f01a467daeba2c1adf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:25.529765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.619434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1014/2025] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:25.629979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.631426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.711751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cc-7ba7-44e2-ad18-27ab1db53d07 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.778903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.779943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.780240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.780844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.791898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.793869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.808147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1012/2026] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:25.834569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.837031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.886319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:25.895349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c1fd-a312-4df0-bdfc-021b31570c5a service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.899199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.900017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.900492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.900847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.903519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:25.930563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7358-d97d-4627-89c1-53432a671a72 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:25.936389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:25.937360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:25.937933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:25.937933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] PATH_INFO: `/v3/projects/872ecad8671e4cc8a6d8e6732a1d5d93` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:25.939074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] RBAC: Authorizing `identity:delete_project(project_id=872ecad8671e4cc8a6d8e6732a1d5d93)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.941659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.969098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:25.971039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:25.984182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1013/2027] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:26.010048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872ecad8671e4cc8a6d8e6732a1d5d93', 'request_id': 'req-d320db3c-afd4-4595-b2ce-ee775120835c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.019475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872ecad8671e4cc8a6d8e6732a1d5d93', 'request_id': 'req-d320db3c-afd4-4595-b2ce-ee775120835c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.029036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872ecad8671e4cc8a6d8e6732a1d5d93', 'request_id': 'req-d320db3c-afd4-4595-b2ce-ee775120835c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.050754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] The token cache is being invalidate because project 872ecad8671e4cc8a6d8e6732a1d5d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:26.051045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.053257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.056595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1015/2028] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:25 2022] DELETE /identity/v3/projects/872ecad8671e4cc8a6d8e6732a1d5d93 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:26.060830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:26.075185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95710-860e-4d9b-a57c-2bf6858a9128 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:26.157762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:26.158642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.158925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.159200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] PATH_INFO: `/v3/users/44cadb92a0b4480486bafba6844ab463` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.160437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cadb92a0b4480486bafba6844ab463)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:26.162368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:26.219221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cadb92a0b4480486bafba6844ab463'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.220027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cadb92a0b4480486bafba6844ab463'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.233823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cadb92a0b4480486bafba6844ab463'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.245107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cadb92a0b4480486bafba6844ab463'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.245992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-684c7941-22a2-446e-b62f-faf993fbf3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cadb92a0b4480486bafba6844ab463'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.269824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1014/2029] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:26 2022] DELETE /identity/v3/users/44cadb92a0b4480486bafba6844ab463 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:26.272088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:26.274118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.292327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320db3c-afd4-4595-b2ce-ee775120835c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:26.403523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:26.404877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.405316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.405610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] PATH_INFO: `/v3/users/1fbc1a8598f5491cb3c76897f93d4678` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.406842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc1a8598f5491cb3c76897f93d4678)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:26.409515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:26.469264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc1a8598f5491cb3c76897f93d4678'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.470302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc1a8598f5491cb3c76897f93d4678'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.487983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc1a8598f5491cb3c76897f93d4678'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.498812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc1a8598f5491cb3c76897f93d4678'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.509721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc1a8598f5491cb3c76897f93d4678'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.520729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1016/2030] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:26 2022] DELETE /identity/v3/users/1fbc1a8598f5491cb3c76897f93d4678 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:26.528620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.529106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.529640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.567141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:26.568418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.638584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1015/2031] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:26.648346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:26.650205 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.679432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:26.680973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.693094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf9c6-ce20-4730-ace3-9c143db59470 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:26.708942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:26.709813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.710925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.711326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] PATH_INFO: `/v3/projects/e6db266673c742b1ad26070506ed614e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.712618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6db266673c742b1ad26070506ed614e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:26.714594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:26.729540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc03c1-8752-4a9b-8457-059473144f61 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:26.733672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:26.734457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.734816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.735159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.746104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:26.747769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92670951-7ae4-4a62-8e06-d532af2b0062 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:26.767479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1017/2032] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:26.779939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6db266673c742b1ad26070506ed614e', 'request_id': 'req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.789770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6db266673c742b1ad26070506ed614e', 'request_id': 'req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.796238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6db266673c742b1ad26070506ed614e', 'request_id': 'req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.807825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] The token cache is being invalidate because project e6db266673c742b1ad26070506ed614e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:26.808243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.808934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3afeaf8a-6e65-4ec2-b25c-8c85346333c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:26.810513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1016/2033] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:26 2022] DELETE /identity/v3/projects/e6db266673c742b1ad26070506ed614e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:26.815587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.815914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.816148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.837358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:26.838667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.906609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1018/2034] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:26.915762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.916065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.916323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.939932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:26.940991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:26.950225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1017/2035] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:26.954251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:26.964289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e13ad-b47e-4553-8cea-c46f7f8136ec None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:26.969254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:26.969923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:26.970203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:26.970478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:26.971212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:26.971565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:26.973170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:26.985942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1019/2036] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:26.990447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.000448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b98c-037d-4c08-9f6f-a5c30b58de74 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.005284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.006117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.006471 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.006847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.007642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.009580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.039202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1018/2037] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:26 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:27.040495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.050236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f1c2-c8d9-425c-a8ce-de691bbb52a3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.079853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.081705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.123306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.123995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.124277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.124602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.125695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.127823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.153404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1020/2038] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:27 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:27.154639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.163843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6bb5f-0151-429a-b1da-22eb8add971f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.166364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98ee-f7fe-44a4-bf24-790808a0031e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.168631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.169263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.169540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.169801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.170511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.171410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.172208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.172326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.172539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.172806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] PATH_INFO: `/v3/projects/d00025caa4dc487d8071c803e57e9145` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.173991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00025caa4dc487d8071c803e57e9145)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.175908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.182557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1021/2039] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:27.186647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.195991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b528b-8c9e-4e58-8707-b244a22d85b0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.201499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.202130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.202410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.202690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.203428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.205313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.216302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1022/2040] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:27.220135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.226234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00025caa4dc487d8071c803e57e9145', 'request_id': 'req-40a63366-a087-4ba4-b4a9-2932258e519a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.229319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa995977-d6c8-4369-b1f1-0e2530883f34 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.234511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00025caa4dc487d8071c803e57e9145', 'request_id': 'req-40a63366-a087-4ba4-b4a9-2932258e519a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.239786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00025caa4dc487d8071c803e57e9145', 'request_id': 'req-40a63366-a087-4ba4-b4a9-2932258e519a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.250949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] The token cache is being invalidate because project d00025caa4dc487d8071c803e57e9145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:27.251232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.251913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.253466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1019/2041] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:27 2022] DELETE /identity/v3/projects/d00025caa4dc487d8071c803e57e9145 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:27.257227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.258493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.283713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.284598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.284873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.285140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] PATH_INFO: `/v3/projects/46d8b5dd420a45a1a80f831da8f4d02d/users/82a453f20c6546308f77db71099b48b4/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.300345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d8b5dd420a45a1a80f831da8f4d02d, user_id=82a453f20c6546308f77db71099b48b4, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.302979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c88a-31b3-4056-a724-554cc0950180 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.316804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1023/2042] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:27 2022] PUT /identity/v3/projects/46d8b5dd420a45a1a80f831da8f4d02d/users/82a453f20c6546308f77db71099b48b4/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:27.323338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a63366-a087-4ba4-b4a9-2932258e519a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.327434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.327723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.328395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.352457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] MFA Rules not processed for user `82a453f20c6546308f77db71099b48b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:27.353635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.381065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.381951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.382282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.382487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] PATH_INFO: `/v3/users/269f647eaf924f01a467daeba2c1adf9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.383735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] RBAC: Authorizing `identity:delete_user(user_id=269f647eaf924f01a467daeba2c1adf9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.385655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.429166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1024/2043] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:27.437546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269f647eaf924f01a467daeba2c1adf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.438209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269f647eaf924f01a467daeba2c1adf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.442817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.444215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.450113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269f647eaf924f01a467daeba2c1adf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.456881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269f647eaf924f01a467daeba2c1adf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.457648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269f647eaf924f01a467daeba2c1adf9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.470611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1020/2044] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:27 2022] DELETE /identity/v3/users/269f647eaf924f01a467daeba2c1adf9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:27.499218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf6f31-86eb-4697-b5cf-11e634fdb8d8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.553322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.554030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.554334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.554605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.556950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.649899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.651442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08bb23-0f09-4310-a467-bf55a53fe6ad service glance] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.663965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1025/2045] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:27.776148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:27.778110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:27.857147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ab9a-a120-4a44-9291-1b3f6588476b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:27.862719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:27.863634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.863910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.864182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] PATH_INFO: `/v3/projects/8011f40e920040688ec08a55418b8cbc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.865357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8011f40e920040688ec08a55418b8cbc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:27.867244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:27.914395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8011f40e920040688ec08a55418b8cbc', 'request_id': 'req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.921907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8011f40e920040688ec08a55418b8cbc', 'request_id': 'req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.929087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8011f40e920040688ec08a55418b8cbc', 'request_id': 'req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.939961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] The token cache is being invalidate because project 8011f40e920040688ec08a55418b8cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:27.940249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.940882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b6f2dcd6-8d3f-440b-b5be-55dc5b1730ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:27.942469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1021/2046] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:27 2022] DELETE /identity/v3/projects/8011f40e920040688ec08a55418b8cbc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:27.947642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:27.948260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:27.948613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:27.966555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:27.967795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:28.030154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1026/2047] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:28.038205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799eb7-895c-421b-ace2-688184facc03 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.038653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799eb7-895c-421b-ace2-688184facc03 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.038892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799eb7-895c-421b-ace2-688184facc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.057496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-32799eb7-895c-421b-ace2-688184facc03 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:28.058766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-32799eb7-895c-421b-ace2-688184facc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:28.066855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1022/2048] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:28.071634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.084085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08eea2-c92a-4b8a-bba4-8b2f281b9e0b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.088702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.089418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.089702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.090552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.091286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:28.091611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.093212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.107062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1027/2049] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:28.112004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799eb7-895c-421b-ace2-688184facc03 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.125178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799eb7-895c-421b-ace2-688184facc03 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.133386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.134282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.134572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.134978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.135760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.138400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.170295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1023/2050] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:28 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:28.174174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.184669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2068f6-d6d6-489a-8056-a9e466181c01 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.243837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.244557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.244836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.245107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.245838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.247866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.267199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1028/2051] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:28 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:28.271570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.282273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc68239-de7d-4d56-89da-8c6fde8255bc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.286829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.287531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.287811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.288083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.288804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.290380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.300521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1024/2052] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:28.304212 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.313989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3e203-3eb1-4e68-9d3d-dfce33ca1d3f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.318702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.319378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.319663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.319938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.320655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.322239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c441388-a805-4cc6-91a4-9bdfe3094737 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.333514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1029/2053] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:28.337552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.348040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739c8d-7a30-490d-8c60-4f233e85f217 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.352614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.353486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.353767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.354041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] PATH_INFO: `/v3/projects/3b2d4798a5e346c3a819372c19ccc41e/users/17f5762f3b344970ac7166fb07ee2212/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.367980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2d4798a5e346c3a819372c19ccc41e, user_id=17f5762f3b344970ac7166fb07ee2212, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.370601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.383186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1025/2054] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:28 2022] PUT /identity/v3/projects/3b2d4798a5e346c3a819372c19ccc41e/users/17f5762f3b344970ac7166fb07ee2212/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:28.393730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.394016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.394314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.420624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] MFA Rules not processed for user `17f5762f3b344970ac7166fb07ee2212`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:28.421932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:28.484518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1030/2055] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:28.495642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:28.497857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:28.551688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b0f82-6765-4abb-8e6f-d2c637213e93 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:28.555248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:28.555911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:28.556193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:28.556459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:28.564948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:28.566279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836c0be-46ad-4f93-b721-45a0d4bb2469 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:28.575969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1026/2056] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:30.277638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:30.279022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:30.344742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a258314-8a47-4000-be3b-c8408f1ff7ad None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:30.350106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:30.351002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:30.351309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:30.351608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] PATH_INFO: `/v3/users/0f542f367b994423bd7f00a4633c142c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:30.352836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f542f367b994423bd7f00a4633c142c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:30.354838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:30.401790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f542f367b994423bd7f00a4633c142c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.402446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f542f367b994423bd7f00a4633c142c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.419157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f542f367b994423bd7f00a4633c142c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.425953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f542f367b994423bd7f00a4633c142c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.434407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f542f367b994423bd7f00a4633c142c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.440447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1031/2057] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:30 2022] DELETE /identity/v3/users/0f542f367b994423bd7f00a4633c142c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:30.445175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:30.445632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:30.445752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:30.462921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:30.464137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:30.521913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1027/2058] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:30.531604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:30.533008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:30.594487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d48ba9-3b38-4834-ad49-712b729d1832 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:30.598234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:30.598881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:30.599161 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:30.599467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:30.609257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:30.610685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:30.619898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1032/2059] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:30.886959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:30.889048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:30.900604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3cac1-47b5-40e9-a166-53d0fc04e28e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:30.906367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:30.907494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:30.907660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:30.907925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] PATH_INFO: `/v3/projects/008617d83138436baa2d9cd32b1a9326` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:30.909270 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008617d83138436baa2d9cd32b1a9326)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:30.911336 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:30.966197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008617d83138436baa2d9cd32b1a9326', 'request_id': 'req-2944958c-7d02-43eb-a973-6ca043258663'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.976445 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008617d83138436baa2d9cd32b1a9326', 'request_id': 'req-2944958c-7d02-43eb-a973-6ca043258663'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:30.987123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008617d83138436baa2d9cd32b1a9326', 'request_id': 'req-2944958c-7d02-43eb-a973-6ca043258663'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.000232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] The token cache is being invalidate because project 008617d83138436baa2d9cd32b1a9326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:31.000506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.001305 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.003793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1028/2060] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:30 2022] DELETE /identity/v3/projects/008617d83138436baa2d9cd32b1a9326 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:31.007760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:31.018755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba1002-4ded-41e1-9466-9c14be51bb3d service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:31.094063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:31.095845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.096214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.096567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] PATH_INFO: `/v3/users/ba3f63163ba74e07a93878520062de7f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.098428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3f63163ba74e07a93878520062de7f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:31.100707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:31.220258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3f63163ba74e07a93878520062de7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.221669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3f63163ba74e07a93878520062de7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.238642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3f63163ba74e07a93878520062de7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.249858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3f63163ba74e07a93878520062de7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.264406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7c932af4-a3be-4b55-98e3-a4a1098d8128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3f63163ba74e07a93878520062de7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.273518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1033/2061] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:31 2022] DELETE /identity/v3/users/ba3f63163ba74e07a93878520062de7f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:31.629771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:31.631473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:31.650952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944958c-7d02-43eb-a973-6ca043258663 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:31.724864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:31.726080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.726512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.726868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] PATH_INFO: `/v3/projects/092237d35c8947279615fb857e3c6b33` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.728361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] RBAC: Authorizing `identity:delete_project(project_id=092237d35c8947279615fb857e3c6b33)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:31.730357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:31.795311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092237d35c8947279615fb857e3c6b33', 'request_id': 'req-92f1142d-d026-422c-9a48-f72f71da343b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.802697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092237d35c8947279615fb857e3c6b33', 'request_id': 'req-92f1142d-d026-422c-9a48-f72f71da343b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.808234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092237d35c8947279615fb857e3c6b33', 'request_id': 'req-92f1142d-d026-422c-9a48-f72f71da343b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.820846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] The token cache is being invalidate because project 092237d35c8947279615fb857e3c6b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:31.821125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.821773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-92f1142d-d026-422c-9a48-f72f71da343b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:31.824168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1029/2062] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:31 2022] DELETE /identity/v3/projects/092237d35c8947279615fb857e3c6b33 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:31.830207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.830846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.830846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.848106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:31.849897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:31.919674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1034/2063] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:31.928657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.928965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.929299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.953135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:31.953135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:31.961819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1030/2064] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:31.966321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:31.975807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208285-25ec-4079-9e39-35b61fd03366 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:31.980282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:31.981487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:31.981761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:31.982031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:31.982746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:31.983088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:31.984714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:31.995901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1035/2065] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:32.000844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.010096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9d20-d97d-4929-8b00-71a12845373c None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.014849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.015563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.015849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.016122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.016814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.018693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.043583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1031/2066] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:31 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:32.048173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.057920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761b558-d6f3-4b29-b0a7-f3ebd4b9948a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.113000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.113675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.113921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.114192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.114880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.116991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.138334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1036/2067] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:32 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:32.142321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.152968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ca17-4038-4db7-94c1-bfdb4b763524 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.157586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.158243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.158555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.158845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.159612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.161200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.172107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1032/2068] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:32.175576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.186238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaf0e2-0d7c-494b-bf6f-abdc52902d0c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.190886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.191559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.191838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.192107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.192847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.194428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c4fd-99d1-443a-bd78-a717c8328f01 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.204310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1037/2069] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:32.208217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.218533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fdd5f-20b3-4be7-9975-15accbad28c5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.223303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.224211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.224495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.224768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] PATH_INFO: `/v3/projects/ca33973ed2624f1d96ee3197d5f0c07f/users/50a20c7efc8945e4b4e54aa33795e2b3/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.239291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca33973ed2624f1d96ee3197d5f0c07f, user_id=50a20c7efc8945e4b4e54aa33795e2b3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.241974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.254091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1033/2070] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:32 2022] PUT /identity/v3/projects/ca33973ed2624f1d96ee3197d5f0c07f/users/50a20c7efc8945e4b4e54aa33795e2b3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:32.265138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.265494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.265774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.291387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] MFA Rules not processed for user `50a20c7efc8945e4b4e54aa33795e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:32.292592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:32.355053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1038/2071] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:32.366686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:32.368678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:32.436577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83993ac9-617c-40d4-a733-72c86dfb576b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:32.440621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:32.441343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:32.441628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:32.441931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:32.453675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:32.455101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85796387-1457-448d-8b0b-a458cd29719f service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:32.473372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1034/2072] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:37.018173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.019820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:37.085676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d755c08-dc33-4702-b83f-c9ad32644969 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.090945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.091956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.092360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.092646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] PATH_INFO: `/v3/users/80f5d755374c4464a2436c456260b2ee` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.093869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f5d755374c4464a2436c456260b2ee)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.096049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.146178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f5d755374c4464a2436c456260b2ee'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.146825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f5d755374c4464a2436c456260b2ee'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.158204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f5d755374c4464a2436c456260b2ee'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.164807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f5d755374c4464a2436c456260b2ee'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.176317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f5d755374c4464a2436c456260b2ee'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.183252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1039/2073] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:37 2022] DELETE /identity/v3/users/80f5d755374c4464a2436c456260b2ee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:37.188474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.188972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.189374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.206703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:37.208022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:37.266597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1035/2074] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:37.276219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.277638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:37.341530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972eb3-75bd-487d-be8e-b38ab750583c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.345188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.345827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.346107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.346379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.355070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.357058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.366174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1040/2075] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:37.638980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.640699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:37.657554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb07a-a05f-4220-868b-13687a8cc4be None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.662428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.663441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.663795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.664204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] PATH_INFO: `/v3/projects/dc58d7896d904e3d8f02c28b1e225b85` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.665467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc58d7896d904e3d8f02c28b1e225b85)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.667571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.722102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc58d7896d904e3d8f02c28b1e225b85', 'request_id': 'req-6230bff6-6d20-49ad-9095-92debdfeea59'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.729528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc58d7896d904e3d8f02c28b1e225b85', 'request_id': 'req-6230bff6-6d20-49ad-9095-92debdfeea59'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.736785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc58d7896d904e3d8f02c28b1e225b85', 'request_id': 'req-6230bff6-6d20-49ad-9095-92debdfeea59'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.749653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] The token cache is being invalidate because project dc58d7896d904e3d8f02c28b1e225b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:37.750083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.751156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.753304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1036/2076] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:37 2022] DELETE /identity/v3/projects/dc58d7896d904e3d8f02c28b1e225b85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:37.758849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:37.770919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d781-a0ab-4662-abe5-ddd7b5e615b7 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:37.847864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:37.848878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:37.849158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:37.849428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] PATH_INFO: `/v3/users/9c7787de1e58454e8f54e1f544d2b746` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:37.850637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7787de1e58454e8f54e1f544d2b746)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:37.852802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:37.904841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7787de1e58454e8f54e1f544d2b746'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.905362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7787de1e58454e8f54e1f544d2b746'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.920241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7787de1e58454e8f54e1f544d2b746'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.926751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7787de1e58454e8f54e1f544d2b746'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.935101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6336d20e-6a6c-47e8-84db-ae33af3e8e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7787de1e58454e8f54e1f544d2b746'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:37.941572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1041/2077] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:37 2022] DELETE /identity/v3/users/9c7787de1e58454e8f54e1f544d2b746 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:38.205571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.207602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:38.221308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230bff6-6d20-49ad-9095-92debdfeea59 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.282909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.283804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.284091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.284366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] PATH_INFO: `/v3/projects/972006e839a54f3c85b973a6cc19f84b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.285548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=972006e839a54f3c85b973a6cc19f84b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.287475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.335145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972006e839a54f3c85b973a6cc19f84b', 'request_id': 'req-45119089-8d3d-4cab-9491-9c1c7e109dce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:38.343945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972006e839a54f3c85b973a6cc19f84b', 'request_id': 'req-45119089-8d3d-4cab-9491-9c1c7e109dce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:38.349850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972006e839a54f3c85b973a6cc19f84b', 'request_id': 'req-45119089-8d3d-4cab-9491-9c1c7e109dce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:38.361116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] The token cache is being invalidate because project 972006e839a54f3c85b973a6cc19f84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:38.361431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:38.362070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-45119089-8d3d-4cab-9491-9c1c7e109dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:38.363867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1037/2078] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:38 2022] DELETE /identity/v3/projects/972006e839a54f3c85b973a6cc19f84b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:38.369462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.370019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.370019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.389318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:38.390586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:38.454483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1042/2079] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:38.462804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.463091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.463411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.483901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:38.484988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:38.498624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1038/2080] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:38.504847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.514630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c67ce-072b-4372-b79b-be2aab9ff612 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.521167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.521832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.522109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.522375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.523088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:38.523448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.525037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.537112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1043/2081] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:38.541412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.552109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90789a-9392-4398-aca6-728520f1dadd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.556758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.557427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.557705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.557979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.559245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.561139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.589686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1039/2082] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:38.593661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.603182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788e8c-9a4e-47f7-8839-c4c89b441ed6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.662754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.663474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.663751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.664020 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.664719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.666669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.691429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1044/2083] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:38.695250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.705987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc82a3-ec90-4fd9-9177-cf4e063401d2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.711088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.712076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.712209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.712495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.713281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.714945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.726210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1040/2084] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:38.730699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.741534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4d990-a13c-4a8b-91f6-1a8f48b243ff admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.747674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.748338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.748617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.749010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.749875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.751542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae5da-5cd5-4fd5-8e5a-f4f84953089f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.764485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1045/2085] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:38.765612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.775800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01203d1-e63e-48dd-a614-c0962bdb7c06 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.780465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.781361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.781640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.781914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] PATH_INFO: `/v3/projects/153ac669dfd940a9858d79aa41830c2b/users/70aa1d9c945e446b92c21dcbe0b537b3/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.799245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153ac669dfd940a9858d79aa41830c2b, user_id=70aa1d9c945e446b92c21dcbe0b537b3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.801977 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.823310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1041/2086] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:38 2022] PUT /identity/v3/projects/153ac669dfd940a9858d79aa41830c2b/users/70aa1d9c945e446b92c21dcbe0b537b3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:38.828530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.829014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.829405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.860260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] MFA Rules not processed for user `70aa1d9c945e446b92c21dcbe0b537b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:38.861507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:38.875751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.877660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:38.937005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1046/2087] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:38.938012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:38.945314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db45df-d2e0-4d3d-8470-f3a627f57f03 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.948742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b2b5d-b578-4497-9bbe-d9c5bb9e9193 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:38.950951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.951913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.952190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.952460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] PATH_INFO: `/v3/users/17f5762f3b344970ac7166fb07ee2212` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.954068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f5762f3b344970ac7166fb07ee2212)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.956332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:38.959369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:38.964404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:38.965663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:38.966178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:38.967132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:38.969357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.006459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1047/2088] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:38 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:39.010922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.020696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f5762f3b344970ac7166fb07ee2212'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.021869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f5762f3b344970ac7166fb07ee2212'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.037798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f5762f3b344970ac7166fb07ee2212'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.044017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f5762f3b344970ac7166fb07ee2212'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.044906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-b8d38656-246e-416d-b64a-d884d2b20eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f5762f3b344970ac7166fb07ee2212'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.060091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1042/2089] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:38 2022] DELETE /identity/v3/users/17f5762f3b344970ac7166fb07ee2212 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:39.065361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.065883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.066158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.084023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:39.085269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.106010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e142-683c-4bfc-ad04-995a0ab6f27b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.154908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1043/2090] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:39.166118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.167761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.181011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.181970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.182356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.182642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.183418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.187086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.220132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1048/2091] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:39 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:39.221424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.223591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.232257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b57d63-68a1-44f8-9e46-367d75e6ea24 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.236613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.237255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.237615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.237820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.239356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b481e1-7d45-46bc-99bb-94d4a53cc189 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.246001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.246672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.246957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.247258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.247844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.248026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.249476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.250282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.259298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1044/2092] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:39.278376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1049/2093] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:39.282650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.292488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e83c3-5cb5-4133-83aa-5f0908bf819f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.307400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.308463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.308737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.309016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] PATH_INFO: `/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46/users/14b71e0724b448ce80595cf954268641/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.325396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79ea814794a4a54b3a5c3e78d8c4a46, user_id=14b71e0724b448ce80595cf954268641, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.328083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.341517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1045/2094] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:39 2022] PUT /identity/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46/users/14b71e0724b448ce80595cf954268641/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:39.345812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.358558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988886e3-37eb-40ba-9583-bb538c76178a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.422954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.423885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.424172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.424580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.425310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.426923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64eca-4180-4e17-9bc5-5bc40d634b1b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.438010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1050/2095] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:39.442284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.453611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b4b3-47ae-47e1-b848-78eb545b71d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.458424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.459543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.459683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.459905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] PATH_INFO: `/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46/users/14b71e0724b448ce80595cf954268641/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.462043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79ea814794a4a54b3a5c3e78d8c4a46, user_id=14b71e0724b448ce80595cf954268641, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.465533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.478315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1046/2096] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:39 2022] PUT /identity/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46/users/14b71e0724b448ce80595cf954268641/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:39.488554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.488881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.489118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.518183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] MFA Rules not processed for user `14b71e0724b448ce80595cf954268641`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:39.519435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.552355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.554149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.623740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1051/2097] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:39.628317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49310a3e-4f40-462d-9074-f36ddbc02b0c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.631141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:39.632569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.633143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.634010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.634287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.634560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] PATH_INFO: `/v3/projects/3b2d4798a5e346c3a819372c19ccc41e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.635791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2d4798a5e346c3a819372c19ccc41e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.637713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.689385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2d4798a5e346c3a819372c19ccc41e', 'request_id': 'req-0db3a1b7-4553-4475-bd7e-e026441f56f6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.697611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2d4798a5e346c3a819372c19ccc41e', 'request_id': 'req-0db3a1b7-4553-4475-bd7e-e026441f56f6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.699792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614bea-27f2-4b17-8a6c-baa86eeb149e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:39.703874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2d4798a5e346c3a819372c19ccc41e', 'request_id': 'req-0db3a1b7-4553-4475-bd7e-e026441f56f6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.715441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] The token cache is being invalidate because project 3b2d4798a5e346c3a819372c19ccc41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:39.715741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.716414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:39.717996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1047/2098] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:39 2022] DELETE /identity/v3/projects/3b2d4798a5e346c3a819372c19ccc41e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:39.753721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:39.754299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:39.754581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:39.754854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:39.756769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:39.826130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:39.829209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadf65-c7fc-4195-a03f-b9bff1c8d294 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:39.843962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1052/2099] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:40.432961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.434888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:40.498433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a1b7-4553-4475-bd7e-e026441f56f6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.502892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.503788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.504067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.504337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] PATH_INFO: `/v3/users/70aa1d9c945e446b92c21dcbe0b537b3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.505510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70aa1d9c945e446b92c21dcbe0b537b3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.507428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.554652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70aa1d9c945e446b92c21dcbe0b537b3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:40.555253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70aa1d9c945e446b92c21dcbe0b537b3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:40.567395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70aa1d9c945e446b92c21dcbe0b537b3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:40.575823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70aa1d9c945e446b92c21dcbe0b537b3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:40.576622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70aa1d9c945e446b92c21dcbe0b537b3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:40.595438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1048/2100] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:40 2022] DELETE /identity/v3/users/70aa1d9c945e446b92c21dcbe0b537b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:40.599878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.600371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.600454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.617507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:40.618714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:40.677511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1053/2101] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:40.689058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:40.690488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:40.756179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ae687-8c70-4e9d-b43c-7db5b85e3221 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:40.765529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:40.766661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:40.766973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:40.767244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:40.778114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:40.779575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:40.789210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1049/2102] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:41.120057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.122181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.137464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2c971-20db-4731-96ad-4e373406723a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.143204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.144436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.144653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.144926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] PATH_INFO: `/v3/projects/153ac669dfd940a9858d79aa41830c2b` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.146122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153ac669dfd940a9858d79aa41830c2b)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.148109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.198509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153ac669dfd940a9858d79aa41830c2b', 'request_id': 'req-7ecadae0-0fe7-4f17-8114-aa8d062682b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.203778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153ac669dfd940a9858d79aa41830c2b', 'request_id': 'req-7ecadae0-0fe7-4f17-8114-aa8d062682b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.209585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153ac669dfd940a9858d79aa41830c2b', 'request_id': 'req-7ecadae0-0fe7-4f17-8114-aa8d062682b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.221624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] The token cache is being invalidate because project 153ac669dfd940a9858d79aa41830c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:41.221913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.222532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.224135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1054/2103] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:41 2022] DELETE /identity/v3/projects/153ac669dfd940a9858d79aa41830c2b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:41.228366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.239624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8617-52a0-466a-a02d-725e5c6b770f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.298914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.299814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.300096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.300366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] PATH_INFO: `/v3/users/14b71e0724b448ce80595cf954268641` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.301557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b71e0724b448ce80595cf954268641)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.303502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.351938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b71e0724b448ce80595cf954268641'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.352773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b71e0724b448ce80595cf954268641'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.367852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b71e0724b448ce80595cf954268641'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.372539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b71e0724b448ce80595cf954268641'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.373261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-97e6ade0-894d-40be-b6b8-f3931a894d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b71e0724b448ce80595cf954268641'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.388287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1050/2104] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:41 2022] DELETE /identity/v3/users/14b71e0724b448ce80595cf954268641 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:41.674228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.675720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.688458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadae0-0fe7-4f17-8114-aa8d062682b5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.744118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.745008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.745304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.745572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] PATH_INFO: `/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.747027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79ea814794a4a54b3a5c3e78d8c4a46)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.748948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.792124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79ea814794a4a54b3a5c3e78d8c4a46', 'request_id': 'req-c879d362-9cb9-4b9b-b558-320683febdda'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.797545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79ea814794a4a54b3a5c3e78d8c4a46', 'request_id': 'req-c879d362-9cb9-4b9b-b558-320683febdda'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.803362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79ea814794a4a54b3a5c3e78d8c4a46', 'request_id': 'req-c879d362-9cb9-4b9b-b558-320683febdda'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.814846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] The token cache is being invalidate because project b79ea814794a4a54b3a5c3e78d8c4a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:41.815128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.815766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c879d362-9cb9-4b9b-b558-320683febdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:41.817267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1055/2105] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:41 2022] DELETE /identity/v3/projects/b79ea814794a4a54b3a5c3e78d8c4a46 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:41.822047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.822516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.822617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.840845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:41.842026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.907136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1051/2106] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:41.915856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.916142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.916417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.935766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:41.936958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:41.944653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1056/2107] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:41.950543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.961858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec4aac-97c3-4dd8-97a4-dd7c42f16a0f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:41.966843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:41.967974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:41.967974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:41.968349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:41.969402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:41.969777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:41.971460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:41.985791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1052/2108] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:40:41.988828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:41.998449 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185483c4-73bb-474d-9de9-76d38addf015 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.005992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.006656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.006937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.007211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.007934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.010099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.036982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1057/2109] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:42.041005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.050846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837ae1-4ee3-4b85-88e1-28dab8454d0e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.107401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.108068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.108351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.108655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.109351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.111243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.130864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1053/2110] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:42 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:42.134300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.145529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724931ce-fbef-4c8f-88f1-15c969b39fc8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.150536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.151321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.151604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.151901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.152882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.154684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.166306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1058/2111] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:42.170179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.179919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368d56-b5ef-44b6-ac5b-1ffcfbe277ed admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.184932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.185573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.185850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.186121 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.186834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.188429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879fe3-f2d2-438e-9ce5-5babc8a0df1e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.198294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1054/2112] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:42.202950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.213117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37de6a-ea2b-44eb-8e20-2c42d974bc67 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.217620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.218486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.218760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.219030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] PATH_INFO: `/v3/projects/e9f097ccf60a4bd3a79fbf84c7d5d93d/users/8376e3a098ba4953860ec0e9c432f7ec/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.233618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f097ccf60a4bd3a79fbf84c7d5d93d, user_id=8376e3a098ba4953860ec0e9c432f7ec, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.236312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.251299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1059/2113] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:42 2022] PUT /identity/v3/projects/e9f097ccf60a4bd3a79fbf84c7d5d93d/users/8376e3a098ba4953860ec0e9c432f7ec/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:42.261396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.261685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.261965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.288380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] MFA Rules not processed for user `8376e3a098ba4953860ec0e9c432f7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:42.289583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:42.350606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1055/2114] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:42.361834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:42.363571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:42.423980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568f0c-74ac-4dba-aea0-fc9cadd0c27f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:42.427767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:42.428438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:42.428718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:42.428989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:42.438176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:42.439644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:42.448516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1060/2115] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:43.398603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:43.400155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:43.471918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8529a-a68a-4e74-97f8-18bca1b3a40f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:43.476580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:43.478916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:43.478916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:43.478916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] PATH_INFO: `/v3/users/da53e103c1e74a9b8907a7076b234171` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:43.479234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] RBAC: Authorizing `identity:delete_user(user_id=da53e103c1e74a9b8907a7076b234171)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:43.481215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:43.527861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da53e103c1e74a9b8907a7076b234171'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.528512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da53e103c1e74a9b8907a7076b234171'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.539893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da53e103c1e74a9b8907a7076b234171'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.546398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da53e103c1e74a9b8907a7076b234171'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.547044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2b9a1628-4ec0-4a75-aa1d-0f6f43cfbdba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da53e103c1e74a9b8907a7076b234171'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.564500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1056/2116] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:43 2022] DELETE /identity/v3/users/da53e103c1e74a9b8907a7076b234171 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:43.738694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:43.750709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887bc7-7629-46ad-94ad-8d5c69c9629c service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:43.812013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:43.812996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:43.813277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:43.813547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] PATH_INFO: `/v3/projects/08265213a8e840179ab9d62cf0bc86ab` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:43.814718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08265213a8e840179ab9d62cf0bc86ab)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:43.816646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:43.872837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08265213a8e840179ab9d62cf0bc86ab', 'request_id': 'req-899a0621-30f2-4f82-a461-99e16088fe1b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.880442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08265213a8e840179ab9d62cf0bc86ab', 'request_id': 'req-899a0621-30f2-4f82-a461-99e16088fe1b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.887411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08265213a8e840179ab9d62cf0bc86ab', 'request_id': 'req-899a0621-30f2-4f82-a461-99e16088fe1b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.900777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] The token cache is being invalidate because project 08265213a8e840179ab9d62cf0bc86ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:43.901329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.901965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-899a0621-30f2-4f82-a461-99e16088fe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:43.903558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1061/2117] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:43 2022] DELETE /identity/v3/projects/08265213a8e840179ab9d62cf0bc86ab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:43.914422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:43.914422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:43.914422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:43.937264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:43.938602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:44.003203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1057/2118] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:44.011807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.012116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.012410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.030249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:44.031472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:44.039193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1062/2119] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:44.043872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.053517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84918-f8d6-494c-8ecd-5b72fc7caf14 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.058088 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.059408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.059690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.059964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.060855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:44.060980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.062546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.077586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1058/2120] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:44.078631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.087740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2331ae-1ee4-4d86-8d86-ad2a29257a77 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.092397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.093036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.093317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.093590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.094415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.096363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.127120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1063/2121] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:44.131477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.141222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc7b8-12ea-41b6-b238-be2cb01abb94 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.196101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.196764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.197050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.197326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.198282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.200250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.220810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1059/2122] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:44.224985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.235412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfbae-1b3f-4a44-a97a-b7ebe1d47c9f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.240120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.240770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.241048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.241315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.242029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.243698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.254110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1064/2123] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:44.257817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.267421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05855-d414-4213-922a-64ce5a2bd071 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.277631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.278319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.278603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.278869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.279632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.281237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c67d5-0d13-48f6-a2b4-3fdddfc1a88b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.293373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1060/2124] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:44.297417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.307325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299f4f1-b625-40ac-9ef0-e1ceb16664a6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.312076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.312944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.313226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.313501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] PATH_INFO: `/v3/projects/949693c308c941aa8593612f12c897cc/users/f3e559c68aad4c88b12b528c0895ab9b/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.328324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=949693c308c941aa8593612f12c897cc, user_id=f3e559c68aad4c88b12b528c0895ab9b, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.330988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.344321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1065/2125] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:44 2022] PUT /identity/v3/projects/949693c308c941aa8593612f12c897cc/users/f3e559c68aad4c88b12b528c0895ab9b/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:44.356432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.356829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.357111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.388260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] MFA Rules not processed for user `f3e559c68aad4c88b12b528c0895ab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:44.389468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:44.455080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1061/2126] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:44.466165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:44.467890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:44.525050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4a42-67a0-4b33-85d9-435ab7cc2d3b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:44.529499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:44.530136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:44.530410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:44.530701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:44.538832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:44.540281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8890b-d78c-4298-9faa-99f1f4d6ea0d service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:44.548826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1066/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:50.859818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:50.861229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:50.925976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0c573-30d9-4eb9-9733-5772cb848910 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:50.930510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:50.931545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:50.931824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:50.932097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] PATH_INFO: `/v3/users/8376e3a098ba4953860ec0e9c432f7ec` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:50.933313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8376e3a098ba4953860ec0e9c432f7ec)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:50.935945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:50.988590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8376e3a098ba4953860ec0e9c432f7ec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:50.989281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8376e3a098ba4953860ec0e9c432f7ec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.000871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8376e3a098ba4953860ec0e9c432f7ec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.007489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8376e3a098ba4953860ec0e9c432f7ec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.008173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8376e3a098ba4953860ec0e9c432f7ec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.026542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1062/2128] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:50 2022] DELETE /identity/v3/users/8376e3a098ba4953860ec0e9c432f7ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:51.028084 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.029056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.029143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.046578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.047787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.109798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1067/2129] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:51.119775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.121279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.182699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ef9a-b1c9-4b7f-be59-649f654147f5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.186396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.187053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.187368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.187643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.197580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.199259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa160e-66f6-444f-befe-62d5e98d4547 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.209522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1063/2130] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:51.542380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.543910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.561902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960463-fe1c-4a3c-96ec-fa3037a725dd None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.567933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.569192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.569793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.570379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] PATH_INFO: `/v3/projects/e9f097ccf60a4bd3a79fbf84c7d5d93d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.572060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f097ccf60a4bd3a79fbf84c7d5d93d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.574465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.632091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f097ccf60a4bd3a79fbf84c7d5d93d', 'request_id': 'req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.637598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f097ccf60a4bd3a79fbf84c7d5d93d', 'request_id': 'req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.644138 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f097ccf60a4bd3a79fbf84c7d5d93d', 'request_id': 'req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.658041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] The token cache is being invalidate because project e9f097ccf60a4bd3a79fbf84c7d5d93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:51.658324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.658941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9d4b5c51-ad37-4af6-9bcc-1fb016779dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:51.660553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1068/2131] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:51 2022] DELETE /identity/v3/projects/e9f097ccf60a4bd3a79fbf84c7d5d93d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:51.666083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.666375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.666648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.685347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.686460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.744482 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1064/2132] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:51.753587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.753872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.754147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.772424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:51.773638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:51.781374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1069/2133] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:51.785571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.795169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61573-b945-4ed6-aabf-f118849eb79a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.799902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.800580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.800861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.801137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.801853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:51.802158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.803775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.815560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1065/2134] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:51.819796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.829520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed98c6-c936-4dc1-a6af-49524b0bb979 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.834520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.835153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.835462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.835735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.836529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.838390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.863314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1070/2135] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:51.867425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.877699 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6d3b-402a-450d-b3cd-8b168521657a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.935708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.936337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.936614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.936881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.937566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.939675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:51.960351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1066/2136] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:51 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:51.964605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:51.979657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3fdcc-a1b9-40e0-a476-9fa96f2fd6b1 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:51.984864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:51.985515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:51.985793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:51.986061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:51.986781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:51.988397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.000004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1071/2137] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:52.004415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.014887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea420-55f2-4072-9576-784489b6b7f7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.020303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.020993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.021274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.021589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.022299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.023948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d014f6b-3f76-484b-bfcd-ab94af75883c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.033764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1067/2138] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:52.037695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.048094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06482d2f-d3d9-4311-90cb-b0b17fb427f1 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.052842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.053715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.053994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.054265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] PATH_INFO: `/v3/projects/52d3f84c81c145ef9e595184700a0488/users/054bf83b92374bbabc2d34277b672f53/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.069926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d3f84c81c145ef9e595184700a0488, user_id=054bf83b92374bbabc2d34277b672f53, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.072639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.085324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1072/2139] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:52 2022] PUT /identity/v3/projects/52d3f84c81c145ef9e595184700a0488/users/054bf83b92374bbabc2d34277b672f53/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:52.095991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.096288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.096566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.124053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] MFA Rules not processed for user `054bf83b92374bbabc2d34277b672f53`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:52.125264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.187923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1068/2140] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:52.218770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.220629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.280244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb9f4-40d5-4ffb-a8a8-37a7ada54fb6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.284033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.284721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.284996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.285250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.294901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.296373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e8c8a-868d-48e6-a646-711a47cd9a05 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.305049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1073/2141] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:52.319284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.380196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a4cce-2aac-4905-9797-771ee4b5ff79 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.384816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.385690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.385969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.386247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] PATH_INFO: `/v3/users/054bf83b92374bbabc2d34277b672f53` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.387567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=054bf83b92374bbabc2d34277b672f53)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.389495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.436248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054bf83b92374bbabc2d34277b672f53'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:52.436899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054bf83b92374bbabc2d34277b672f53'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:52.448329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054bf83b92374bbabc2d34277b672f53'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:52.454710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054bf83b92374bbabc2d34277b672f53'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:52.455475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054bf83b92374bbabc2d34277b672f53'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:52.472460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1069/2142] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:52 2022] DELETE /identity/v3/users/054bf83b92374bbabc2d34277b672f53 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:52.477218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.477496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.477786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.502178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:52.503564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.570905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1074/2143] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:52.582063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.583669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.646612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efb5c1-11d9-4852-b734-28bad139ad48 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.650346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.650995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.651288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.651591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.661394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.663343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891c06-163a-426f-a59d-9c69d0907e05 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:52.674281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1070/2144] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:52.940214 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:52.941676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:52.955734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582fff-8a36-4c9a-8482-b6f618b7084e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:52.960378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:52.961916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:52.962363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:52.962644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] PATH_INFO: `/v3/projects/52d3f84c81c145ef9e595184700a0488` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:52.963983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d3f84c81c145ef9e595184700a0488)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:52.966510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.011767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d3f84c81c145ef9e595184700a0488', 'request_id': 'req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:53.017400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d3f84c81c145ef9e595184700a0488', 'request_id': 'req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:53.023518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d3f84c81c145ef9e595184700a0488', 'request_id': 'req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:53.036219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] The token cache is being invalidate because project 52d3f84c81c145ef9e595184700a0488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:53.036517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:53.037116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-736bdbd1-cced-4b6c-8ccd-63bd1abd502e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:53.038699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1075/2145] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:52 2022] DELETE /identity/v3/projects/52d3f84c81c145ef9e595184700a0488 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:53.043587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.044020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.044132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.061240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:53.062433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:53.124682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1071/2146] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:53.132640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.132948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.133281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.151724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:53.152936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:53.161481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1076/2147] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:53.165786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.175725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7078-f910-4ccf-97d5-e1e1ec515330 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.180479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.181167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.181490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.181795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.182520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:53.182821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.185420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.197005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1072/2148] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:53.207314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.220153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b577-ff46-455a-818b-11c1426ac2a0 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.224967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.225616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.225890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.226160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.226925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.228875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.254845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1077/2149] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:53.258862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.270837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6e066-d2d0-40ee-879a-33ffc5b3b76e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.329697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.330368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.330650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.330925 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.331670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.333597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.353432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1073/2150] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:53.357635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.367912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906d10-3464-41b5-97cc-1a92a3d8c511 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.372925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.373570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.373845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.374114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.374823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.376450 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.386355 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1078/2151] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:53.391079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.400886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb0657-acee-4845-93e6-39a56fbcdd1b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.405508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.406215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.406501 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.406779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.407530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.409114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38377d9-5cb6-4f84-bc90-9c732a38185b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.419000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1074/2152] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:53.423342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:53.436296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1b4f-1155-4a48-bbd7-b344a7405571 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:53.440983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:53.441850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.442153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.442420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] PATH_INFO: `/v3/projects/91418b9e49344e6799481fc32b6afc63/users/8148c8361e00496c92d7a20f01219434/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.457403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91418b9e49344e6799481fc32b6afc63, user_id=8148c8361e00496c92d7a20f01219434, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:53.460013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:53.472146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1079/2153] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:53 2022] PUT /identity/v3/projects/91418b9e49344e6799481fc32b6afc63/users/8148c8361e00496c92d7a20f01219434/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:53.486724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1f44-f9a3-44c7-9bf6-a12fb3ee5c04 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:53.487302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1f44-f9a3-44c7-9bf6-a12fb3ee5c04 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:53.487668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1f44-f9a3-44c7-9bf6-a12fb3ee5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:53.515326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1b7b1f44-f9a3-44c7-9bf6-a12fb3ee5c04 None None] MFA Rules not processed for user `8148c8361e00496c92d7a20f01219434`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:53.516551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1b7b1f44-f9a3-44c7-9bf6-a12fb3ee5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:53.579248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1075/2154] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:54.955967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:54.957807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.026265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b4a0c-677a-40b5-b0e0-f72d7be453d0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.032100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.033006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.033284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.033553 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] PATH_INFO: `/v3/users/f3e559c68aad4c88b12b528c0895ab9b` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.034756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e559c68aad4c88b12b528c0895ab9b)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.036773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.084428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e559c68aad4c88b12b528c0895ab9b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.084998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e559c68aad4c88b12b528c0895ab9b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.096146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e559c68aad4c88b12b528c0895ab9b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.102545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e559c68aad4c88b12b528c0895ab9b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.110120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e559c68aad4c88b12b528c0895ab9b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.116357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1080/2155] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:54 2022] DELETE /identity/v3/users/f3e559c68aad4c88b12b528c0895ab9b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:55.120946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.121438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.121557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.139307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:55.140500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.197376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1076/2156] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:55.207085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.208503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.263963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3d622-327b-47fa-8427-0348336fee77 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.267595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.268235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.268516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.268788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.277541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.278988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430b930-f790-437d-870c-0c49e9d92d6c service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.288210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1081/2157] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:55.568467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.569885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.583435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1098dd3-9f9d-40bc-9c6e-2a7c3f1d5926 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.589583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.590451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.591236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.591541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] PATH_INFO: `/v3/projects/949693c308c941aa8593612f12c897cc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.593184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] RBAC: Authorizing `identity:delete_project(project_id=949693c308c941aa8593612f12c897cc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.594729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.642145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949693c308c941aa8593612f12c897cc', 'request_id': 'req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.650128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949693c308c941aa8593612f12c897cc', 'request_id': 'req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.656599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949693c308c941aa8593612f12c897cc', 'request_id': 'req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.667565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] The token cache is being invalidate because project 949693c308c941aa8593612f12c897cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:55.667854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.668530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cbae9432-7a1c-4b5a-b6f4-dc0780ac606a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:55.671193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1077/2158] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:55 2022] DELETE /identity/v3/projects/949693c308c941aa8593612f12c897cc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:55.676415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.676705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.677021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.694927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:55.696170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.753469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1082/2159] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:55.761234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.761524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.761872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.781508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:55.782723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:55.790632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1078/2160] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:55.794897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.804352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a13575-8dcc-4fde-9114-c9edbd5e7f69 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.808872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.809527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.809803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.810075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.810788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:55.811117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.812731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.825465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1083/2161] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:55.829689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.838767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c799f-1ca9-41bf-851c-45386dd23c02 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.844089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.844732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.845016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.845297 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.845991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.847922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.872756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1079/2162] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:55.876937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.892350 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf01e7-259b-428a-9aee-7404a06add37 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:55.955024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:55.956602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:55.957299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:55.957299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:55.958429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:55.960649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:55.984860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1084/2163] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:55 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:40:55.986676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:55.997691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d5abb-ae31-45c3-a321-a24052c44e92 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.003585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.004605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.004974 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.005386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.006274 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.008146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.023620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1080/2164] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:56.024930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.038900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799703f4-c9b2-47b9-8653-ca67899ec337 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.047309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.047309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.047309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.047309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.047766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.048833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0527cc-1c43-41d2-b60e-343aaa9e87ad admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.063642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1085/2165] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:56.068865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.079458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426362-07e0-4161-9913-d0cfb8fca2e0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.084046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.084905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.085212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.085484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] PATH_INFO: `/v3/projects/c1fb376f1cd545f19a0052b57669692d/users/9368c66cd8f645c9b3e68c01077ff0f9/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.101558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fb376f1cd545f19a0052b57669692d, user_id=9368c66cd8f645c9b3e68c01077ff0f9, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.104742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.123532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1081/2166] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:56 2022] PUT /identity/v3/projects/c1fb376f1cd545f19a0052b57669692d/users/9368c66cd8f645c9b3e68c01077ff0f9/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:56.134409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.134842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.135247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.161921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] MFA Rules not processed for user `9368c66cd8f645c9b3e68c01077ff0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:56.163147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:56.235464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1086/2167] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:56.241169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.299863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f294a0c-1a52-45cb-9c6c-fd30e6e3912f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.304553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.305219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.305500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.305771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.306464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.308424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.334711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1082/2168] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:56 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:56.338810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.349614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90b1fd-d2a9-4a93-aa10-99e096d728a3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.406543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.407587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.408106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.408464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.409175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.411135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.435035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1087/2169] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:56 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:56.436290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.446522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00e4b-6d70-4edb-b683-49b99d9d853c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.452198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.452928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.453208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.453507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.454234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.455905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.466855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1083/2170] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:40:56.471174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.481752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1adf7-5806-4424-8c56-9b18120767bc admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.486296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.487165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.487477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.487749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] PATH_INFO: `/v3/projects/482b80076dc844309da189d8acc4473a/users/60dd91ba93f34e708f1ee867257d4c9d/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.502190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482b80076dc844309da189d8acc4473a, user_id=60dd91ba93f34e708f1ee867257d4c9d, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.504873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.517611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1088/2171] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:56 2022] PUT /identity/v3/projects/482b80076dc844309da189d8acc4473a/users/60dd91ba93f34e708f1ee867257d4c9d/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:56.521619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.531223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a1ae-0cb4-4425-a3b6-42de3ad18cbb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.588648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.589908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.590310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.590736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.592205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.594344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b653c-1b32-4242-be6d-0d7ffa0b3dba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.604800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1084/2172] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:56.609572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.619580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362323a-1368-4403-9129-ae93e5e04324 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.624930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.625795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.626074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.626343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] PATH_INFO: `/v3/projects/482b80076dc844309da189d8acc4473a/users/60dd91ba93f34e708f1ee867257d4c9d/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.628306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482b80076dc844309da189d8acc4473a, user_id=60dd91ba93f34e708f1ee867257d4c9d, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.630928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.641322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1089/2173] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:56 2022] PUT /identity/v3/projects/482b80076dc844309da189d8acc4473a/users/60dd91ba93f34e708f1ee867257d4c9d/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:56.652502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.652778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.653041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.678672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] MFA Rules not processed for user `60dd91ba93f34e708f1ee867257d4c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:56.679839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:56.753487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1085/2174] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:56.764905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:56.766605 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:56.823256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60437-a6f9-46b0-a3ff-d531210fe8a2 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:56.826892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:56.827569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:56.827844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:56.828113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:56.836711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:56.838120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c84108-2c57-4b1a-888c-695121bcdb17 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:56.847141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1090/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:40:57.245328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.313389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f9cda-9fe8-4108-9a90-8d09fe8891a9 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.317934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.318802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.319082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.328242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] PATH_INFO: `/v3/users/9368c66cd8f645c9b3e68c01077ff0f9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.328242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9368c66cd8f645c9b3e68c01077ff0f9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.328242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.368476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9368c66cd8f645c9b3e68c01077ff0f9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.369129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9368c66cd8f645c9b3e68c01077ff0f9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.381296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9368c66cd8f645c9b3e68c01077ff0f9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.387852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9368c66cd8f645c9b3e68c01077ff0f9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.388569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9368c66cd8f645c9b3e68c01077ff0f9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.401848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1086/2176] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:57 2022] DELETE /identity/v3/users/9368c66cd8f645c9b3e68c01077ff0f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:57.406966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.407430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.407678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.425332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:57.438363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.490973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1091/2177] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:57.502384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.503866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.560881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73acdc4-e5ab-4d62-a766-4425f6ff1976 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.564541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.565168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.565447 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.565720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.574703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.576180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.585692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1087/2178] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:40:57.856908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.858387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:57.870153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa44bcb-045d-48a6-ae0e-42983d94198c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:57.874738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:57.875702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:57.875985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:57.876258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] PATH_INFO: `/v3/projects/c1fb376f1cd545f19a0052b57669692d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:57.877442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fb376f1cd545f19a0052b57669692d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:57.879521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:57.927768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fb376f1cd545f19a0052b57669692d', 'request_id': 'req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.933102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fb376f1cd545f19a0052b57669692d', 'request_id': 'req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.939295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fb376f1cd545f19a0052b57669692d', 'request_id': 'req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.952516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] The token cache is being invalidate because project c1fb376f1cd545f19a0052b57669692d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:57.952837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.953473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:57.955075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1092/2179] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:57 2022] DELETE /identity/v3/projects/c1fb376f1cd545f19a0052b57669692d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:57.959134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:57.971204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39975b22-d4df-4cde-8bf9-cde820e0fc4b service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.032716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.033600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.033881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.034177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] PATH_INFO: `/v3/users/60dd91ba93f34e708f1ee867257d4c9d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.035407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=60dd91ba93f34e708f1ee867257d4c9d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.037342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.082031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60dd91ba93f34e708f1ee867257d4c9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.082681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60dd91ba93f34e708f1ee867257d4c9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.094167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60dd91ba93f34e708f1ee867257d4c9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.100962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60dd91ba93f34e708f1ee867257d4c9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.101665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e4b1521e-752a-4c0c-83f0-d847e8ac0dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60dd91ba93f34e708f1ee867257d4c9d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.114692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1088/2180] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:40:57 2022] DELETE /identity/v3/users/60dd91ba93f34e708f1ee867257d4c9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:40:58.421916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.423909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:58.436978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3eb8-23b0-4c16-a05b-9f98c4a894cf admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.506894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.509110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.509110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.509110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] PATH_INFO: `/v3/projects/482b80076dc844309da189d8acc4473a` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.515308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482b80076dc844309da189d8acc4473a)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.517234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.565573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482b80076dc844309da189d8acc4473a', 'request_id': 'req-c1b508ed-e034-40b9-bcde-880af60cc038'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.571025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482b80076dc844309da189d8acc4473a', 'request_id': 'req-c1b508ed-e034-40b9-bcde-880af60cc038'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.577753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482b80076dc844309da189d8acc4473a', 'request_id': 'req-c1b508ed-e034-40b9-bcde-880af60cc038'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.590202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] The token cache is being invalidate because project 482b80076dc844309da189d8acc4473a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:40:58.590704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.591954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c1b508ed-e034-40b9-bcde-880af60cc038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:40:58.593549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1093/2181] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:40:58 2022] DELETE /identity/v3/projects/482b80076dc844309da189d8acc4473a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:58.598443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.598902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.598999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.616035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:58.617219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:58.675895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1089/2182] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:58.683614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.683898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.684193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.703022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:58.704613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:58.712725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1094/2183] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:40:58.717634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.727360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90928d8d-9d89-488d-a821-55e8104d8000 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.731967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.732618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.732902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.733180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.733899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:40:58.734209 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.735839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.747615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1090/2184] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:40:58.751858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.763049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a2d1-39ac-4ee2-ab8f-e7b819e47ceb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.767880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.768528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.768808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.769159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.769869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.771883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.797261 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1095/2185] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:40:58 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:58.801322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.816165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25b9fa-f749-414d-8afc-bd074e329fbc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.882280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.882953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.883248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.883539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.884303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.886215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.909131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1091/2186] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:40:58 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:40:58.910520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.921002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6690d-02d6-4267-aa04-f3b5d0f5148c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.925645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.926288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.926562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.926829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.927580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.929160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.940897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1096/2187] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:58.944845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.955818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc059ed-18fd-4c30-930e-3af3c431f3fb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.960487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.961295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.961580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.961855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:58.962576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:58.964338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859399-0d93-4fb0-a563-6c11221dc057 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:58.975245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1092/2188] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:40:58.979367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:58.991126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e550e-dea9-4eb9-a6a7-d23ad7bf6148 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:58.997454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:58.998439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:58.998719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:58.998992 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] PATH_INFO: `/v3/projects/3ed33fcd1ec443ea8eb0816cbbc6cc49/users/ba8fef59bc50436a8b22899a2dd55af5/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.015209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed33fcd1ec443ea8eb0816cbbc6cc49, user_id=ba8fef59bc50436a8b22899a2dd55af5, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.017802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.030854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1097/2189] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:40:58 2022] PUT /identity/v3/projects/3ed33fcd1ec443ea8eb0816cbbc6cc49/users/ba8fef59bc50436a8b22899a2dd55af5/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:40:59.038053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a666-be41-45c2-a17d-b3efda0252bb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.038053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a666-be41-45c2-a17d-b3efda0252bb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.038053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a666-be41-45c2-a17d-b3efda0252bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.054476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cb85a666-be41-45c2-a17d-b3efda0252bb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:40:59.055807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cb85a666-be41-45c2-a17d-b3efda0252bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:59.117150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1093/2190] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:40:59.134550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:40:59.136344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:40:59.193889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beae5e-a6a9-4857-9a2b-c6d1e9b229c5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:40:59.198079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:40:59.198808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:40:59.199183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:40:59.199573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:40:59.215921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:40:59.217374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:40:59.228027 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1098/2191] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:41:00.064120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.064663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.064960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.094321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] MFA Rules not processed for user `ba8fef59bc50436a8b22899a2dd55af5`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:00.095675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:00.164047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1094/2192] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:00.168535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.178010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971392c6-52e1-42aa-8e08-0cbf163852db service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.182659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.183335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.183621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.183894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.185248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.187168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.220930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1099/2193] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:00 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:00.222161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.233273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e68ab-9c52-4c25-9392-9e3c5fbc3eb7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.292280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.292945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.293230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.293496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.294689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.296614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.319715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1095/2194] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:00 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:00.321116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.332464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a905ced-760d-4413-8aa5-937db772eb88 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.337329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.337976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.338256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.338528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.339250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.340895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.353082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1100/2195] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:00.357816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.368568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265a5db-84c6-439f-b86e-ae541ddd17de admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.374577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.375494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.375779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.376063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] PATH_INFO: `/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8/users/342d706c26f8416eac8644611c124984/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.390642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ccebb557f4a89b013e02078d6e2b8, user_id=342d706c26f8416eac8644611c124984, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.393346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.408164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1096/2196] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:00 2022] PUT /identity/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8/users/342d706c26f8416eac8644611c124984/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:00.412204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.422392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af1e96-256d-43d7-a04e-d285087688a5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.479920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.480596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.480876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.481684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.482406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.484167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5776b-bbce-485c-9787-f847bdf9f0dc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.497974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1101/2197] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:00.499767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:00.510093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972514-3694-433d-9b4c-275d6d8c5e13 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:00.514893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:00.515800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:00.516078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:00.516345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] PATH_INFO: `/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8/users/342d706c26f8416eac8644611c124984/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:00.518368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ccebb557f4a89b013e02078d6e2b8, user_id=342d706c26f8416eac8644611c124984, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:00.521019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:00.531161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1097/2198] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:00 2022] PUT /identity/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8/users/342d706c26f8416eac8644611c124984/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:01.159909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.160202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.160469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.187087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] MFA Rules not processed for user `342d706c26f8416eac8644611c124984`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:01.188242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:01.257836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1102/2199] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:01.270732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:01.272827 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:01.332550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10810b-661f-44f5-ab2d-4fd0f1e0d9ae admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:01.336737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:01.337380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:01.337659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:01.337931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:01.394219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:01.395683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:01.404550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1098/2200] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:02.739096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.740536 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:02.781805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37ec6-6817-4600-a621-beb3e6229f27 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.785421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.786061 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.786338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.786611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.817333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:02.818768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:02.828907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1103/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:41:02.879013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:02.880486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:02.952146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150ffcd-c957-410e-ad26-fcd04bc5e1b1 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:02.955764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:02.956407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:02.956686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:02.956957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:02.958701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:03.020954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:03.022375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:03.031970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1099/2202] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:15.918504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.004526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f012b3-0500-4fca-882f-93c94d7ddfd4 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.009493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.010470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.010775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.011053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] PATH_INFO: `/v3/users/ba8fef59bc50436a8b22899a2dd55af5` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.012293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8fef59bc50436a8b22899a2dd55af5)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.014785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.069010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8fef59bc50436a8b22899a2dd55af5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.069766 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8fef59bc50436a8b22899a2dd55af5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.088040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8fef59bc50436a8b22899a2dd55af5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.095743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8fef59bc50436a8b22899a2dd55af5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.104753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8fef59bc50436a8b22899a2dd55af5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.112555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1104/2203] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:15 2022] DELETE /identity/v3/users/ba8fef59bc50436a8b22899a2dd55af5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:16.304041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.315936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85687ad5-8707-43ef-9c9b-c8ff42340b15 service glance] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.378933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.380061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.380475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.380849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] PATH_INFO: `/v3/projects/3ed33fcd1ec443ea8eb0816cbbc6cc49` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.382171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed33fcd1ec443ea8eb0816cbbc6cc49)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.384217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.432394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed33fcd1ec443ea8eb0816cbbc6cc49', 'request_id': 'req-422aba15-4c28-46fd-b6f9-b6f5f82d0255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.440768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed33fcd1ec443ea8eb0816cbbc6cc49', 'request_id': 'req-422aba15-4c28-46fd-b6f9-b6f5f82d0255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.446236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed33fcd1ec443ea8eb0816cbbc6cc49', 'request_id': 'req-422aba15-4c28-46fd-b6f9-b6f5f82d0255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.470029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] The token cache is being invalidate because project 3ed33fcd1ec443ea8eb0816cbbc6cc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:16.470317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.470956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.472517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1100/2204] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:16 2022] DELETE /identity/v3/projects/3ed33fcd1ec443ea8eb0816cbbc6cc49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:16.476380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.477752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:16.490865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b849b-8d89-4c7d-8a3e-dc48f22d21f5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.544755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.546116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.546396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.546667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] PATH_INFO: `/v3/users/342d706c26f8416eac8644611c124984` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.547936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=342d706c26f8416eac8644611c124984)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.549801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.592503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342d706c26f8416eac8644611c124984'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.593137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342d706c26f8416eac8644611c124984'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.604178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342d706c26f8416eac8644611c124984'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.611089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342d706c26f8416eac8644611c124984'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.618100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bdef71fb-512d-4fb5-8fba-6122871d67bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342d706c26f8416eac8644611c124984'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.624727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1105/2205] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:16 2022] DELETE /identity/v3/users/342d706c26f8416eac8644611c124984 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:16.798791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:16.800327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:16.815355 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aba15-4c28-46fd-b6f9-b6f5f82d0255 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:16.871237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:16.872115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.872394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.872665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] PATH_INFO: `/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:16.873842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5ccebb557f4a89b013e02078d6e2b8)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:16.875889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:16.922866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5ccebb557f4a89b013e02078d6e2b8', 'request_id': 'req-517b1e6e-5f5c-4a86-94fc-b57d83745649'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.929967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5ccebb557f4a89b013e02078d6e2b8', 'request_id': 'req-517b1e6e-5f5c-4a86-94fc-b57d83745649'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.935243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5ccebb557f4a89b013e02078d6e2b8', 'request_id': 'req-517b1e6e-5f5c-4a86-94fc-b57d83745649'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.945891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] The token cache is being invalidate because project 0f5ccebb557f4a89b013e02078d6e2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:16.946177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.946791 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-517b1e6e-5f5c-4a86-94fc-b57d83745649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:16.948604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1101/2206] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:16 2022] DELETE /identity/v3/projects/0f5ccebb557f4a89b013e02078d6e2b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:16.953429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:16.953869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:16.953968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.007101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.008369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.064060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1106/2207] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:17.071674 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.072010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.072292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.091512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.093389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.101578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1102/2208] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:17.105745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.116638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f6b8-39db-409d-b1cc-c0797ee39bf5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.121204 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.121855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.122129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.122401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.123816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:17.124124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.125714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.137500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1107/2209] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:17.142223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.151106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142accd-00c4-47f9-9c7d-3c9ccf328eea None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.156433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.157078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.157357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.157629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.158311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.160235 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.185187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1103/2210] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:17.189358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.199990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094b52-f01f-48b7-90f3-6973827eabc5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.265890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.266557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.266833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.267103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.267819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.269722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.290548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1108/2211] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:17.295026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.306344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493950a-01ae-4fcc-b7f8-2a2f013e6fc0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.311745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.312435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.312712 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.312984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.313713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.315311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.325798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1104/2212] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:17.330615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.340737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72909b4-a16c-47b3-8829-8202f6c545b3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.346779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.347595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.348051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.348665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.349498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.353021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cc0b4-477a-4853-9a07-d03bcd13da08 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.366714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1109/2213] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:17.370843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.382118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35fa5-147c-4d98-9195-736fc5638972 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.387100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.388034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.388343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.389320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] PATH_INFO: `/v3/projects/40189510220c4dae94b7b883ee79142b/users/41ffc1845a454b44b0cfe7e3948bc42c/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.403932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40189510220c4dae94b7b883ee79142b, user_id=41ffc1845a454b44b0cfe7e3948bc42c, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.407113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.419960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1105/2214] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:17 2022] PUT /identity/v3/projects/40189510220c4dae94b7b883ee79142b/users/41ffc1845a454b44b0cfe7e3948bc42c/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:17.431145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.431663 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.431991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.461838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] MFA Rules not processed for user `41ffc1845a454b44b0cfe7e3948bc42c`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.463033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.528636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1110/2215] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:17.539835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.541515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.600333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1440db-db82-4ce6-9a2e-637570b1539e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.604019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.604760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.605039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.605308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.613859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.615318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c1752-dab1-455d-809e-20728509419a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.625176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1106/2216] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:17.645237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.707995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f15f9-916e-4aa1-9930-cb9146cfd70f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.712713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.713617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.713881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.714156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] PATH_INFO: `/v3/users/41ffc1845a454b44b0cfe7e3948bc42c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.715456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ffc1845a454b44b0cfe7e3948bc42c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.717435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:17.765434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ffc1845a454b44b0cfe7e3948bc42c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:17.766391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ffc1845a454b44b0cfe7e3948bc42c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:17.777837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ffc1845a454b44b0cfe7e3948bc42c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:17.784448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ffc1845a454b44b0cfe7e3948bc42c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:17.793704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ffc1845a454b44b0cfe7e3948bc42c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:17.800162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1111/2217] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:17 2022] DELETE /identity/v3/users/41ffc1845a454b44b0cfe7e3948bc42c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:17.804877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.805229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.805583 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.823443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:17.824631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.889821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1107/2218] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:17.899286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:17.900750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:17.980995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bb8f-0e7f-4aab-b391-3c99ee2414fd admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:17.986135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:17.986938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:17.987496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:17.987759 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:17.997669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:17.999919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19963da-abfa-4589-8e1d-7731d5ec2437 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.009908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1112/2219] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:18.308227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.309916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:18.333214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f5e86-099f-4a81-9869-1226074b60ce None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.338572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.339761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.340213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.340874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] PATH_INFO: `/v3/projects/40189510220c4dae94b7b883ee79142b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.342115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40189510220c4dae94b7b883ee79142b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.344264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.395215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40189510220c4dae94b7b883ee79142b', 'request_id': 'req-9db9587d-c03f-44e0-84b3-9235ca5e25e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:18.411344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40189510220c4dae94b7b883ee79142b', 'request_id': 'req-9db9587d-c03f-44e0-84b3-9235ca5e25e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:18.417408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40189510220c4dae94b7b883ee79142b', 'request_id': 'req-9db9587d-c03f-44e0-84b3-9235ca5e25e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:18.430655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] The token cache is being invalidate because project 40189510220c4dae94b7b883ee79142b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:18.430655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:18.430655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9db9587d-c03f-44e0-84b3-9235ca5e25e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:18.431753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1108/2220] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:18 2022] DELETE /identity/v3/projects/40189510220c4dae94b7b883ee79142b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:18.437217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.437501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.437774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.456112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:18.457407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:18.516720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1113/2221] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:18.524276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.524824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.525313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.543503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:18.544695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:18.552938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1109/2222] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:18.557525 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.567541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8641d1f-550c-4af7-9399-4a91de863e93 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.572073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.572722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.573255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.573530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.574503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:18.574810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.577093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.588798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1114/2223] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:41:18.593558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.602553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509b1a1-aeca-4379-b26e-4a806328417b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.607102 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.608257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.608531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.608795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.609475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.611354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.635524 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1110/2224] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:41:18.639558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.649245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492011-f1ef-43f9-9245-5d4166458025 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.703093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.703794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.704077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.704353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.705041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.707144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.725543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1115/2225] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:18.729538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.740005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf1f2-5095-42e6-aed8-98b4a2dadc1b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.744461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.745104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.745380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.745647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.746350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.747959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.758495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1111/2226] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:18.762146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.771787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609785-2314-4308-8ff0-a8321f131c6f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.776307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.776939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.777221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.777495 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.778207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.779822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b252c-ac75-4d96-9623-e4261e2df863 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.789348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1116/2227] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:18.793129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.803446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de33d-c267-4899-8ac6-bc1be1673395 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:18.808091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:18.808946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.809229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.809507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] PATH_INFO: `/v3/projects/5ddc811f750445fca6f57ef193a9afad/users/b73fc8dda2d84835ac8545b2ca55967e/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.824563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddc811f750445fca6f57ef193a9afad, user_id=b73fc8dda2d84835ac8545b2ca55967e, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:18.827193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:18.839984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1112/2228] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:18 2022] PUT /identity/v3/projects/5ddc811f750445fca6f57ef193a9afad/users/b73fc8dda2d84835ac8545b2ca55967e/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:18.850305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:18.850613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:18.850891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:18.876967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] MFA Rules not processed for user `b73fc8dda2d84835ac8545b2ca55967e`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:18.878153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:18.938889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1117/2229] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:18.950206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:18.951932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:19.005822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1904e-f3e8-4e86-b80f-0ee8a6bcca49 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:19.009491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:19.010129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:19.010412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:19.010691 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:19.018793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:19.020238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ca621-05fd-4d68-9265-055cd25095bc service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:19.028869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1113/2230] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:21.645267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.646738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:21.728136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdd8d3-8862-4a46-bc18-70bd35204a7b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.732607 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.733464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.733739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.734008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] PATH_INFO: `/v3/users/50a20c7efc8945e4b4e54aa33795e2b3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.735170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a20c7efc8945e4b4e54aa33795e2b3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.737130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.783620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a20c7efc8945e4b4e54aa33795e2b3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:21.784275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a20c7efc8945e4b4e54aa33795e2b3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:21.795502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a20c7efc8945e4b4e54aa33795e2b3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:21.802141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a20c7efc8945e4b4e54aa33795e2b3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:21.809272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a20c7efc8945e4b4e54aa33795e2b3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:21.815852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1118/2231] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:21 2022] DELETE /identity/v3/users/50a20c7efc8945e4b4e54aa33795e2b3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:21.820440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.820980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.820980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.838525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:21.839780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:21.901772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1114/2232] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:21.911477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:21.912884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:21.971874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e3fc7-0cb8-4af5-b75d-108b9b47e0eb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:21.975547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:21.976192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:21.976470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:21.976743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:21.987497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:21.988933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d0f1-89fc-49f8-a4b3-ed105983492b service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:21.998809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1119/2233] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:22.266675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.268202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:22.286924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990f5c-b9b2-4e06-9dde-ac47841fb9ca None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.292793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.293643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.293922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.294192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] PATH_INFO: `/v3/projects/ca33973ed2624f1d96ee3197d5f0c07f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.296024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca33973ed2624f1d96ee3197d5f0c07f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.297972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.346361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca33973ed2624f1d96ee3197d5f0c07f', 'request_id': 'req-5dd75e13-1fc8-4e3c-9296-113565801874'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:22.354678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca33973ed2624f1d96ee3197d5f0c07f', 'request_id': 'req-5dd75e13-1fc8-4e3c-9296-113565801874'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:22.361854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca33973ed2624f1d96ee3197d5f0c07f', 'request_id': 'req-5dd75e13-1fc8-4e3c-9296-113565801874'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:22.372763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] The token cache is being invalidate because project ca33973ed2624f1d96ee3197d5f0c07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:22.373083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:22.373728 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-5dd75e13-1fc8-4e3c-9296-113565801874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:22.375399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1115/2234] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:22 2022] DELETE /identity/v3/projects/ca33973ed2624f1d96ee3197d5f0c07f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:22.388029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.388029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.388029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.399002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:22.400310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:22.461901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1120/2235] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:22.470338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.470619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.470889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.490449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:22.491873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:22.500036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1116/2236] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:22.504420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.513940 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdc3a2-a086-4946-a799-c4454282e012 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.518471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.519112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.519420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.519698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.520421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:22.520726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.522324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.533994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1121/2237] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:22.538496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.548330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3909-60b7-48d6-94ff-5939495bfc61 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.552843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.553486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.553764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.554032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.554710 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.556621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.581163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1117/2238] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:22.585442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.596639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94dc06-6d6b-4e43-ba70-16de56cd1e13 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.655758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.656431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.656717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.657106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.657820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.659760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.684166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1122/2239] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:22 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:22.685972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.695978 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dcfd6-9053-4889-83cc-214ef3c5c0d4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.701322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.701980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.702259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.702529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.703244 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.704862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.722382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1118/2240] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:22.726069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.737361 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a91db-1c32-4553-bb1b-1cdec1d0d8fd admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.742445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.743105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.743424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.743716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.744452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.746049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea448c-5b98-4bcb-80b7-d16cda9e5a83 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.759427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1123/2241] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:22.768520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.778287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4421d-51d6-4db4-940e-630d13c48d7b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.783647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.784511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.784790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.785077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] PATH_INFO: `/v3/projects/6edbf82991ab4e8188b1da30ec8628af/users/67e37f086e544af59ae16e0c32bd85db/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.799491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edbf82991ab4e8188b1da30ec8628af, user_id=67e37f086e544af59ae16e0c32bd85db, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:22.802629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:22.819888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1119/2242] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:22 2022] PUT /identity/v3/projects/6edbf82991ab4e8188b1da30ec8628af/users/67e37f086e544af59ae16e0c32bd85db/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:22.830730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.831014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.831378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:22.858807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] MFA Rules not processed for user `67e37f086e544af59ae16e0c32bd85db`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:22.860039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:22.923970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1124/2243] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:22.934422 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:22.936136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:22.990051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415713f-79d7-4175-9496-353b937e3aa2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:22.993631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:22.994266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:22.994543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:22.994814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:23.002686 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:23.004111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23bb8a-f8a9-46bc-b0ac-945bcc106305 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:23.012442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1120/2244] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:31.356990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:31.358942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:31.429701 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fa451-1206-4f0e-b0e2-0c3cc709a279 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:31.434088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:31.434956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.435974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.436278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] PATH_INFO: `/v3/users/82a453f20c6546308f77db71099b48b4` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.437496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a453f20c6546308f77db71099b48b4)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:31.439497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:31.491058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a453f20c6546308f77db71099b48b4'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:31.491742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a453f20c6546308f77db71099b48b4'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:31.504168 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a453f20c6546308f77db71099b48b4'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:31.510740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a453f20c6546308f77db71099b48b4'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:31.520178 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a453f20c6546308f77db71099b48b4'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:31.526812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1125/2245] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:31 2022] DELETE /identity/v3/users/82a453f20c6546308f77db71099b48b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:31.531928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.532413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.532552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.549763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:31.550902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:31.615900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1121/2246] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:31.625742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:31.627216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:31.687789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3f933-fe5c-423f-be1f-d73224c40c04 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:31.691415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:31.692058 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:31.692339 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:31.692621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:31.702524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:31.704078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2789e58-d0e8-4fd1-92d0-f410b8ce5fc5 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:31.715199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1126/2247] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:32.145819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.145819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:32.172388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f4c4b-1610-4dea-bd91-2fcafad0579d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.194536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.195637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.196141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.197103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] PATH_INFO: `/v3/projects/46d8b5dd420a45a1a80f831da8f4d02d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.199439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d8b5dd420a45a1a80f831da8f4d02d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.209705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.290904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d8b5dd420a45a1a80f831da8f4d02d', 'request_id': 'req-eacc7637-0c08-487e-a6f8-7d452cbb819f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:32.308215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d8b5dd420a45a1a80f831da8f4d02d', 'request_id': 'req-eacc7637-0c08-487e-a6f8-7d452cbb819f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:32.323083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d8b5dd420a45a1a80f831da8f4d02d', 'request_id': 'req-eacc7637-0c08-487e-a6f8-7d452cbb819f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:32.345349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] The token cache is being invalidate because project 46d8b5dd420a45a1a80f831da8f4d02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:32.345772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:32.346667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-eacc7637-0c08-487e-a6f8-7d452cbb819f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:32.348868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1122/2248] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:32 2022] DELETE /identity/v3/projects/46d8b5dd420a45a1a80f831da8f4d02d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:32.353656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b577b-e031-4081-883a-8001be467b3b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.354135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b577b-e031-4081-883a-8001be467b3b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.354565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b577b-e031-4081-883a-8001be467b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.377603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-587b577b-e031-4081-883a-8001be467b3b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:32.379054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-587b577b-e031-4081-883a-8001be467b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:32.452648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1127/2249] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:32.465943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.466227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.467047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.490560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:32.491948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:32.500156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1123/2250] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:32.504883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b577b-e031-4081-883a-8001be467b3b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.516381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b577b-e031-4081-883a-8001be467b3b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.521414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.523977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.524437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.524998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.525874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:32.526176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.527980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.542216 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1128/2251] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:32.551680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.563908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10c7e-5ba9-430b-ae5e-296b3e9bc6ac None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.570428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.571286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.571637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.571998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.572753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.575718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.607695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1124/2252] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:32 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:32.611468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.622799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a46d-17e8-41b6-a6d0-d0d67e35913d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.699225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.700247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.700725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.701825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.702735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.705162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.730122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1129/2253] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:32 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:32.734859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.745229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827d390-9019-43a1-a2a8-e16dfe80f9ce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.751242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.752064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.752358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.752628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.753379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.754963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.765373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1125/2254] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:41:32.769337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.784798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27ef4-bff2-4a09-a373-6e8677550be2 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.784798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.784798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.785118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.785118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.785837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.787447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a79b-95d0-48df-80df-9e1e478f393c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.798599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1130/2255] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:32.802609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.813191 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1563dd-dd8f-45fe-a0ff-dd1285f12790 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:32.818069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:32.818945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.819222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.819603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] PATH_INFO: `/v3/projects/566cec90becf440c860b261b3153e5d6/users/5e36b0835abc4beebe51d1a6f71ef9fc/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.835618 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566cec90becf440c860b261b3153e5d6, user_id=5e36b0835abc4beebe51d1a6f71ef9fc, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:32.838571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:32.859741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1126/2256] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:32 2022] PUT /identity/v3/projects/566cec90becf440c860b261b3153e5d6/users/5e36b0835abc4beebe51d1a6f71ef9fc/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:32.866019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4589-fa5c-426f-9bc6-631c6f6c42d3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:32.866221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4589-fa5c-426f-9bc6-631c6f6c42d3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:32.866498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4589-fa5c-426f-9bc6-631c6f6c42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:32.900100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-ac1a4589-fa5c-426f-9bc6-631c6f6c42d3 None None] MFA Rules not processed for user `5e36b0835abc4beebe51d1a6f71ef9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:32.901297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ac1a4589-fa5c-426f-9bc6-631c6f6c42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:32.964964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1131/2257] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:32.975735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:32.977477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:33.032307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5263752-a950-497d-ae85-fe4d8f978169 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:33.036404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:33.037122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:33.037406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:33.037680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:33.049863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:33.051318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:33.060747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1127/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:34.443315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc250b-5446-486c-99d9-68865a3f1c45 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:34.443315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc250b-5446-486c-99d9-68865a3f1c45 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:34.443315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc250b-5446-486c-99d9-68865a3f1c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:34.461117 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-adcc250b-5446-486c-99d9-68865a3f1c45 None None] MFA Rules not processed for user `5e36b0835abc4beebe51d1a6f71ef9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:34.462414 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-adcc250b-5446-486c-99d9-68865a3f1c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:34.470115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1132/2259] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:41.676900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:41.678451 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:41.742688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c722-b4cd-4ff3-98dd-4114a38411b8 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:41.747411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:41.748286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:41.748568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:41.748830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] PATH_INFO: `/v3/users/67e37f086e544af59ae16e0c32bd85db` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:41.750115 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e37f086e544af59ae16e0c32bd85db)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:41.751922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:41.802551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e37f086e544af59ae16e0c32bd85db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:41.803851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e37f086e544af59ae16e0c32bd85db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:41.816049 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e37f086e544af59ae16e0c32bd85db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:41.823443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e37f086e544af59ae16e0c32bd85db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:41.824216 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e37f086e544af59ae16e0c32bd85db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:41.838225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1128/2260] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:41 2022] DELETE /identity/v3/users/67e37f086e544af59ae16e0c32bd85db => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:41.843087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:41.843625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:41.843744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:41.864871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:41.866243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:41.956392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1133/2261] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:41.967567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:41.969055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:42.026204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81368-5be8-4726-9c09-383369f0b2f5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:42.030498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:42.031298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.033300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.033300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.041152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:42.042505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:42.052054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1129/2262] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:42.406569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:42.408323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:42.422263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c738d-8ba1-4a53-8234-2316fe7955ac None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:42.433847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:42.434671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:42.434995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:42.435290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] PATH_INFO: `/v3/projects/6edbf82991ab4e8188b1da30ec8628af` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:42.437080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edbf82991ab4e8188b1da30ec8628af)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:42.438934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:42.484786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edbf82991ab4e8188b1da30ec8628af', 'request_id': 'req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:42.489931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edbf82991ab4e8188b1da30ec8628af', 'request_id': 'req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:42.495879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edbf82991ab4e8188b1da30ec8628af', 'request_id': 'req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:42.508374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] The token cache is being invalidate because project 6edbf82991ab4e8188b1da30ec8628af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:42.509180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:42.509308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c97d87a1-1cfd-4cb6-bdaf-6c1d50b0dc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:42.510787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1134/2263] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:42 2022] DELETE /identity/v3/projects/6edbf82991ab4e8188b1da30ec8628af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:43.071837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.074658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.089873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a0e78-9e56-4ab5-9aa3-d1c012026722 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.164148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.165045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.165329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.165635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] PATH_INFO: `/v3/users/b73fc8dda2d84835ac8545b2ca55967e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.166862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73fc8dda2d84835ac8545b2ca55967e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.168887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.216314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73fc8dda2d84835ac8545b2ca55967e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.217065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73fc8dda2d84835ac8545b2ca55967e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.228970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73fc8dda2d84835ac8545b2ca55967e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.236325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73fc8dda2d84835ac8545b2ca55967e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.237025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73fc8dda2d84835ac8545b2ca55967e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.250028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1130/2264] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:41:43 2022] DELETE /identity/v3/users/b73fc8dda2d84835ac8545b2ca55967e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:43.254568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.255029 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.255150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.272110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.273280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.329298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1135/2265] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:43.339208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.340870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.397080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721e508-ded7-4fee-a2b4-d77432f81fe7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.401161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.401813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.402097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.402373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.412253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.413685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35802-82e0-4fd9-92b2-ee10fe7efb7d service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.423950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1131/2266] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:43.687372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.688802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.700892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2544b-0289-41ba-ba94-8cafed892b86 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.705917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.706848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.707130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.707497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] PATH_INFO: `/v3/projects/5ddc811f750445fca6f57ef193a9afad` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.708780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddc811f750445fca6f57ef193a9afad)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.710750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.756305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddc811f750445fca6f57ef193a9afad', 'request_id': 'req-9c535542-ab1e-45f3-945f-9e9496a2a65b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.761445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddc811f750445fca6f57ef193a9afad', 'request_id': 'req-9c535542-ab1e-45f3-945f-9e9496a2a65b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.768300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddc811f750445fca6f57ef193a9afad', 'request_id': 'req-9c535542-ab1e-45f3-945f-9e9496a2a65b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.781152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] The token cache is being invalidate because project 5ddc811f750445fca6f57ef193a9afad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:41:43.781521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.782222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9c535542-ab1e-45f3-945f-9e9496a2a65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:41:43.783871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1136/2267] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:41:43 2022] DELETE /identity/v3/projects/5ddc811f750445fca6f57ef193a9afad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:41:43.789561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.789878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.790157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.807639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.808992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.868131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1132/2268] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:41:43.877170 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.877458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.877767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.895958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:43.897154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:43.904971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1137/2269] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:43.909142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.918654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358eae1-6883-4d5d-91ee-67576061eaee None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.923621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.924266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.924545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.924819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.925528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:41:43.925831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.927428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.939051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1133/2270] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:41:43.943072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:43.952854 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d05df-469b-488e-b14a-93fdcc7a2322 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:43.957538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:43.958179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:43.958458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:43.958732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:43.959481 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:43.961416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:43.986146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1138/2271] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:43.990261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.001014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c17b-b147-4557-83cc-7587ad0b702b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.055508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.056173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.056453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.056723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.057399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.059427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.079065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1134/2272] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:41:43 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:41:44.083244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.093255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cbc7f-d972-4490-807f-3fd008b1b2a6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.097772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.098413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.098688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.098957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.099713 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.101289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.111949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1139/2273] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:44.115764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.126154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258de4-e92f-4f3e-a6db-1ead9ac9e435 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.130760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.131703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.131703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.132117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.132698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.134276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a495b-6d18-4313-8ea9-7ab06b2369f5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.147307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1135/2274] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:41:44.148863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.160176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205da87-d5e5-42c9-82f6-bef74bdf39c7 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.164703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.165564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.165835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.166099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] PATH_INFO: `/v3/projects/0f39ed86a017410b857cfb0b30b4d3a5/users/e3c01bed5f0040b3b8d2d680ecd6436a/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.181575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f39ed86a017410b857cfb0b30b4d3a5, user_id=e3c01bed5f0040b3b8d2d680ecd6436a, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.184277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.196833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1140/2275] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:41:44 2022] PUT /identity/v3/projects/0f39ed86a017410b857cfb0b30b4d3a5/users/e3c01bed5f0040b3b8d2d680ecd6436a/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:41:44.207624 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70dc3a-ae99-48e3-a33e-661aee5498b2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.208026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70dc3a-ae99-48e3-a33e-661aee5498b2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.208365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70dc3a-ae99-48e3-a33e-661aee5498b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.235743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0d70dc3a-ae99-48e3-a33e-661aee5498b2 None None] MFA Rules not processed for user `e3c01bed5f0040b3b8d2d680ecd6436a`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:44.237073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0d70dc3a-ae99-48e3-a33e-661aee5498b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:44.304128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1136/2276] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:41:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:44.315371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:44.321682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:44.401033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d19918-fe02-448f-bb40-8b0924b5407e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:44.405486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:44.406025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:44.406302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:44.406570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:44.422033 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:44.423484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:44.432139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1141/2277] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:41:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:41:59.597538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994d64-88db-4afe-8046-85b8920fac75 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.597990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994d64-88db-4afe-8046-85b8920fac75 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.598099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994d64-88db-4afe-8046-85b8920fac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.652427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ab994d64-88db-4afe-8046-85b8920fac75 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:41:59.653604 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ab994d64-88db-4afe-8046-85b8920fac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:59.719839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1137/2278] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:41:59.765315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:41:59.766796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:41:59.855622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448937-7c69-4702-9693-898c662aa67c service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:41:59.861315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:41:59.861939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:41:59.862218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:41:59.862484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:41:59.870162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:41:59.871751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:41:59.880006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1142/2279] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:41:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:42:00.445703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3688f-7049-4589-82d7-59ee4a3062d2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.445992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3688f-7049-4589-82d7-59ee4a3062d2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.446267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3688f-7049-4589-82d7-59ee4a3062d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.469398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-94e3688f-7049-4589-82d7-59ee4a3062d2 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:00.470637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-94e3688f-7049-4589-82d7-59ee4a3062d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:00.477759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1138/2280] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:00.493952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.504652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece875e-3eaf-4fca-9a73-6b871f288607 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.509798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.510567 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.510882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.511229 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.519516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.521166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.529913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1143/2281] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:42:00.752695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a418-457e-4b04-9b3c-47e41863daba None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.753137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a418-457e-4b04-9b3c-47e41863daba None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.753240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a418-457e-4b04-9b3c-47e41863daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.770994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7601a418-457e-4b04-9b3c-47e41863daba None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:00.772132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7601a418-457e-4b04-9b3c-47e41863daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:00.779749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1139/2282] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:00.791244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:00.801335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1992f3-2b5c-470b-92d0-9971ed5e5113 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:00.806226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:00.806841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:00.807116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:00.807417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:00.815109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:00.816694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:00.824619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1144/2283] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:42:01.144318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.144606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.144882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.161988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:01.163202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:01.175506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1140/2284] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:01.189578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:01.199988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221afb-e6cb-4aed-8282-96c9026fa031 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:01.205453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:01.206077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:01.206354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:01.206623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:01.214405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:01.215978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27a17-9730-4b05-b70e-437320cf1b9e service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:01.223690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1145/2285] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:42:03.276769 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.278204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.373172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9dc41-2a8e-466a-9030-b282611a8f38 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.379476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.380507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.380826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.381240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] PATH_INFO: `/v3/users/5e36b0835abc4beebe51d1a6f71ef9fc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.382585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e36b0835abc4beebe51d1a6f71ef9fc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.384557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.435474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e36b0835abc4beebe51d1a6f71ef9fc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:03.436494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e36b0835abc4beebe51d1a6f71ef9fc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:03.455435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e36b0835abc4beebe51d1a6f71ef9fc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:03.463671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e36b0835abc4beebe51d1a6f71ef9fc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:03.464593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e36b0835abc4beebe51d1a6f71ef9fc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:03.479598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1141/2286] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:42:03 2022] DELETE /identity/v3/users/5e36b0835abc4beebe51d1a6f71ef9fc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:03.490089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.491100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.491448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.510124 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:03.511380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.584563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1146/2287] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:03.597039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.599134 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.710426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a48f-7466-4d54-8bf7-210f28a0f3f1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.722378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.723338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.723782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.724232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.744317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.745740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87f6e-dbdf-46ad-b826-230760ef2169 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:03.756293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1142/2288] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:03.935920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:03.937416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:03.957445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15bed0-b6c9-4f1f-90e4-4b11e7de5d18 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:03.962380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:03.963241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:03.963564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:03.963921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] PATH_INFO: `/v3/projects/566cec90becf440c860b261b3153e5d6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:03.965082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566cec90becf440c860b261b3153e5d6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:03.967652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.016000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566cec90becf440c860b261b3153e5d6', 'request_id': 'req-3b44d32f-f374-49a4-8fbf-31f8f426de03'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.021346 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566cec90becf440c860b261b3153e5d6', 'request_id': 'req-3b44d32f-f374-49a4-8fbf-31f8f426de03'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.027686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566cec90becf440c860b261b3153e5d6', 'request_id': 'req-3b44d32f-f374-49a4-8fbf-31f8f426de03'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.039900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] The token cache is being invalidate because project 566cec90becf440c860b261b3153e5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:42:04.040193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.040816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b44d32f-f374-49a4-8fbf-31f8f426de03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.042989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1147/2289] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:42:03 2022] DELETE /identity/v3/projects/566cec90becf440c860b261b3153e5d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:04.047377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.047668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.047944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.067938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:04.069147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:04.133493 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1143/2290] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:04.141510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.143517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.147775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.178529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:04.180254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:04.199386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.207980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1148/2291] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:04.214089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475884-c56f-4f35-86bc-46ff6c40904f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.220083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.220614 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.220898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.221173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.221966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:42:04.222271 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.224248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.239015 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1144/2292] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:42:04.243629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.254494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bc86-ad4b-41b6-aeb5-86f7af48a072 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.259539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.260202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.260482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.260756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.262090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.264647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.298514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1149/2293] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:42:04.299178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.314780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638a3d-67b2-4c4e-8a82-3eea757c828d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.413747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.415340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.416161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.417202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.417923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.424242 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.459779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1145/2294] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:42:04.461724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.474686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3cbfb-a075-41a0-b0a1-9e23eb527a6c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.480366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.480911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.481181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.481656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.482934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.484617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.510252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1150/2295] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:42:04.512002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.522862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb568b-563d-4f61-8cea-9abb7b41ddc8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.529237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.529932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.530413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.530689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.531469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.533309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac53cc-a92d-4d24-981a-f72fb3d38b88 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.545481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1146/2296] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:42:04.554877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.565671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b7b0-641b-4204-9aab-96f145e9161d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.570563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.571551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.571896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.572241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] PATH_INFO: `/v3/projects/05347ecf2f1e4379bfa0f96c9df28c9c/users/55f7b1ca4478415c9b526c4e4b9e3ca2/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.587910 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05347ecf2f1e4379bfa0f96c9df28c9c, user_id=55f7b1ca4478415c9b526c4e4b9e3ca2, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.590853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.605050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1151/2297] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:42:04 2022] PUT /identity/v3/projects/05347ecf2f1e4379bfa0f96c9df28c9c/users/55f7b1ca4478415c9b526c4e4b9e3ca2/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:04.610513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.610802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.611132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.631097 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:04.632411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:04.694002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1147/2298] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:42:04.703695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.705389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:04.769899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbace1c-a3dc-47ed-9594-3ad7f4468b6e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.771360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:04.773000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:04.774146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.774794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.775080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.775540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.786510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.787767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26bd2-4e69-41ed-b871-95b596b99535 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:04.788096 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ddcb7-fb46-45e8-b5dc-b5499d17e2fb service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.792764 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:04.793642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.793927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.794205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] PATH_INFO: `/v3/users/8148c8361e00496c92d7a20f01219434` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.796065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8148c8361e00496c92d7a20f01219434)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:04.798050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:04.802208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1152/2299] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:04.850668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8148c8361e00496c92d7a20f01219434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.851588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8148c8361e00496c92d7a20f01219434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.867073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8148c8361e00496c92d7a20f01219434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.874531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8148c8361e00496c92d7a20f01219434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.875318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8148c8361e00496c92d7a20f01219434'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:04.892521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1148/2300] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:42:04 2022] DELETE /identity/v3/users/8148c8361e00496c92d7a20f01219434 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:04.897743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5200-9c95-477d-9498-a872d81afb80 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:04.898188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5200-9c95-477d-9498-a872d81afb80 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:04.898554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5200-9c95-477d-9498-a872d81afb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:04.922445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8cdf5200-9c95-477d-9498-a872d81afb80 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:04.923808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8cdf5200-9c95-477d-9498-a872d81afb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.013340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1153/2301] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:42:05.031219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.032714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.093352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.093640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.093912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.110135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede58b4-18d3-43d2-9354-67ec149b16a7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.114456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] MFA Rules not processed for user `e57cd656669e42bea86c8206b333bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:05.116452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.117267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.118065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.118349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.118622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.128732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.130219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.141992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1149/2302] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:05.207369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1154/2303] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:42:05.453901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.455985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.473760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52592103-47fe-4e0c-9ae1-5d13a9559698 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:05.479751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:05.480615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.480891 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.481645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] PATH_INFO: `/v3/projects/91418b9e49344e6799481fc32b6afc63` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:05.483813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91418b9e49344e6799481fc32b6afc63)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:05.486128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:05.535560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91418b9e49344e6799481fc32b6afc63', 'request_id': 'req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:05.543327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91418b9e49344e6799481fc32b6afc63', 'request_id': 'req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:05.549146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91418b9e49344e6799481fc32b6afc63', 'request_id': 'req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:05.561541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] The token cache is being invalidate because project 91418b9e49344e6799481fc32b6afc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:42:05.561815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:05.562590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ef053dd9-d47d-4c8b-8876-6fcf9a7d2914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:05.564392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1150/2304] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:42:05 2022] DELETE /identity/v3/projects/91418b9e49344e6799481fc32b6afc63 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:05.896753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:05.898752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:05.938902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:05.939194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:05.939503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.002200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] MFA Rules not processed for user `55f7b1ca4478415c9b526c4e4b9e3ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:06.004555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:06.113571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2470-a8b0-4791-93c3-3f79e577f3fb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.156144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1151/2305] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:06.182743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:06.187132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:06.249226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.250282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.250869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.251965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.255797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:06.279482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.281335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b76d05-7aad-48d6-9bea-8b17d20022d6 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:06.282519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421df44-098c-4d6a-b7f8-42ca3def3f24 service placement] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.285335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:06.286095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:06.293841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:06.294161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:06.303504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:06.304936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eef2ab-9f1f-46f1-8b0c-75bf7866849c service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:06.306000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1155/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:06.316075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1152/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:07.693380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:07.693909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:07.693909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:07.711278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] MFA Rules not processed for user `55f7b1ca4478415c9b526c4e4b9e3ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:07.712474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:07.719181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1156/2308] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:08.033396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36be38-b828-4db7-9786-7506cbf4f334 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:08.033984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36be38-b828-4db7-9786-7506cbf4f334 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:08.033984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36be38-b828-4db7-9786-7506cbf4f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:08.060967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3c36be38-b828-4db7-9786-7506cbf4f334 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:08.062895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3c36be38-b828-4db7-9786-7506cbf4f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:08.153778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1153/2309] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:42:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:08.166997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:08.168993 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:08.271592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da36b-eb84-45bf-a77e-490372f2541c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:08.276957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:08.277649 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:08.277982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:08.278267 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:08.289043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:08.290702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b2df-0e24-4a07-a9a9-75712cf6243e service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:08.303496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1157/2310] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:42:11.216335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3a00-a0fe-4b74-ad05-9831d04eb781 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:11.217283 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3a00-a0fe-4b74-ad05-9831d04eb781 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:11.217567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3a00-a0fe-4b74-ad05-9831d04eb781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:11.252673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-605c3a00-a0fe-4b74-ad05-9831d04eb781 None None] MFA Rules not processed for user `0334273a56994a7abfa3d72006f7a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:11.254290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-605c3a00-a0fe-4b74-ad05-9831d04eb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:11.378356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1154/2311] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:27.254960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.255574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.255574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.256893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1158/2312] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:27.264917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de37f-6fa3-4a6d-9a33-592ad258e927 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.265915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de37f-6fa3-4a6d-9a33-592ad258e927 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.266194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de37f-6fa3-4a6d-9a33-592ad258e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.315690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ee7de37f-6fa3-4a6d-9a33-592ad258e927 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:27.316950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ee7de37f-6fa3-4a6d-9a33-592ad258e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.402643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1155/2313] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:27.418683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.420516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.501360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693cb0-aba0-4ecb-9900-9e32640de354 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.505574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.506294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.506569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.506834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.517727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.519219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d68f-ead8-44ef-b754-eb4833133925 service glance] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.529628 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1159/2314] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:27.598413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.598619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.598997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.600522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1156/2315] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:42:27.605772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a6e3-6fca-4fb6-a683-4974250d2fb0 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.606152 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a6e3-6fca-4fb6-a683-4974250d2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.606979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a6e3-6fca-4fb6-a683-4974250d2fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.625459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bd02a6e3-6fca-4fb6-a683-4974250d2fb0 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:27.626666 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bd02a6e3-6fca-4fb6-a683-4974250d2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.679397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1160/2316] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:42:27.692116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.693953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.707895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f298c-dccc-4131-8f67-40acee0e486b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.712330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.713062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.713412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.713757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.721840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.723319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b87e-943e-4518-b403-786810a3b887 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.731083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1157/2317] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:27.847762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.848051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.848561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.850149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1161/2318] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 06:42:27.855993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.857206 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.857563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.894181 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:27.895585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.912500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1158/2319] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:27.923996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:27.925679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:27.941548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8c82-49bd-4cd8-8fe9-1fe8385d9fa8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:27.946052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:27.946714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:27.947296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:27.947296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:27.959604 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:27.961037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b197-0999-4d61-bb37-15a64ecde131 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:27.973207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1162/2320] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:29.274515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.275929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:29.339386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f452bb2-76da-4450-9afc-d461c3057005 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.343789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.344653 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.344934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.345208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] PATH_INFO: `/v3/users/e3c01bed5f0040b3b8d2d680ecd6436a` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.346381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c01bed5f0040b3b8d2d680ecd6436a)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.348325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.393227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c01bed5f0040b3b8d2d680ecd6436a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:29.393871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c01bed5f0040b3b8d2d680ecd6436a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:29.405251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c01bed5f0040b3b8d2d680ecd6436a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:29.412041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c01bed5f0040b3b8d2d680ecd6436a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:29.412722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c01bed5f0040b3b8d2d680ecd6436a'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:29.425746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1159/2321] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:42:29 2022] DELETE /identity/v3/users/e3c01bed5f0040b3b8d2d680ecd6436a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:29.430243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.430711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.430807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.448389 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:29.449576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:29.504926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1163/2322] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:42:29.514586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:29.516138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:29.573405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd4677-8443-4398-b3c3-89d59220aa08 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:29.577259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:29.577897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:29.578177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:29.578446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:29.587239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:29.588671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e3e0-f724-45ea-8ff9-0eed4e0ab481 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:29.598413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1160/2323] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:42:30.156823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:30.158368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:30.171860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf36d43-5891-4221-bc13-f34635f46ac2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:30.176808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:30.177682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:30.177961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:30.178418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] PATH_INFO: `/v3/projects/0f39ed86a017410b857cfb0b30b4d3a5` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:30.179875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f39ed86a017410b857cfb0b30b4d3a5)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:30.182021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:30.236860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f39ed86a017410b857cfb0b30b4d3a5', 'request_id': 'req-c2940072-ae9e-485b-86e2-6675423a2469'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:30.242533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f39ed86a017410b857cfb0b30b4d3a5', 'request_id': 'req-c2940072-ae9e-485b-86e2-6675423a2469'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:30.249704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f39ed86a017410b857cfb0b30b4d3a5', 'request_id': 'req-c2940072-ae9e-485b-86e2-6675423a2469'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:30.262307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] The token cache is being invalidate because project 0f39ed86a017410b857cfb0b30b4d3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:42:30.262637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:30.264194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:42:30.265888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1164/2324] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:42:30 2022] DELETE /identity/v3/projects/0f39ed86a017410b857cfb0b30b4d3a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:42:34.761637 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264446f-60ee-4375-8aab-925049a74c82 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.762106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264446f-60ee-4375-8aab-925049a74c82 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.762287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264446f-60ee-4375-8aab-925049a74c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.779440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7264446f-60ee-4375-8aab-925049a74c82 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:42:34.780617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7264446f-60ee-4375-8aab-925049a74c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:34.846187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1161/2325] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:42:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:42:34.858693 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:42:34.860114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:42:34.933770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940072-ae9e-485b-86e2-6675423a2469 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:42:34.940370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:42:34.941017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:42:34.941519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:42:34.941981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:42:34.953542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:42:34.955510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:42:34.963879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1165/2326] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:42:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:43:01.726427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba561-bd89-48fe-96d4-a8e58eb0fad5 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:01.726994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba561-bd89-48fe-96d4-a8e58eb0fad5 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:01.726994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba561-bd89-48fe-96d4-a8e58eb0fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:01.745820 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-8b8ba561-bd89-48fe-96d4-a8e58eb0fad5 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:01.747760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8b8ba561-bd89-48fe-96d4-a8e58eb0fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:01.755175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1162/2327] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:43:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:43:01.781248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:43:01.791542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147605-57b2-4981-9323-a64e1f0d4d76 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:43:01.796618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:43:01.797249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:01.797524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:01.797819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:01.805821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:43:01.807501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46979650-81d0-4f5a-88fa-ef704771861f service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:43:01.816066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1166/2328] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:43:36.499084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:43:36.499599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:43:36.499697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:43:36.516383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] MFA Rules not processed for user `55f7b1ca4478415c9b526c4e4b9e3ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:43:36.517560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:43:36.569664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1163/2329] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:00.613509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:00.614067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:00.614230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:00.632166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] MFA Rules not processed for user `e57cd656669e42bea86c8206b333bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:00.633468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:00.693716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1167/2330] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:04.600127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:04.600915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:04.667550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7535f1-e4ba-4c65-84bd-3a3c0a08c74a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:04.673684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:04.674441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:04.674808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:04.675152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:04.680154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:04.755782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:04.757589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843faba-27a7-45a7-be86-f180f4ff56ce service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:04.770823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1164/2331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:08.375102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:08.384574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a2e6c-8229-4eae-8c17-4974874593e3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:08.388659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:08.389297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:08.389582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:08.389859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:08.391730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:08.405336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:08.406770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:08.417829 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1168/2332] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:13.765697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:13.766232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:13.766232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:13.783018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] MFA Rules not processed for user `0334273a56994a7abfa3d72006f7a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:13.784257 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:13.836496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1165/2333] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:15.441090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:15.442491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:15.456708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196b450-ef95-4815-beb2-36f7c0dda25e service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:15.470873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:15.471647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:15.471989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:15.472325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:15.474098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:15.485163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:15.486771 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77463b-2d6e-4808-ac91-4036e05bb654 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:15.499856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1169/2334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:16.356239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:16.357708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:16.369842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb7ab-4bc7-4e4a-9723-f43b6625e783 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:16.374452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:16.375106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:16.375431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:16.375713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:16.377485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:16.435918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:16.437343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:16.446066 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1166/2335] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:17.580691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:17.581197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:17.581391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:17.599116 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] MFA Rules not processed for user `1f2d12e60ae147198c3940c510616285`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:17.600564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:17.608646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1170/2336] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:17.707233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:17.720277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20f45-3c74-46d5-ae64-77461d89b063 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:17.725667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:17.726970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:17.727252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:17.727555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:17.729383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:17.748061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:17.749679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:17.759466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1167/2337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:18.385151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:18.386652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:18.459747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67a8d-f334-461a-806f-3dd6211a5f97 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:18.464551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:18.465730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:18.466009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:18.466280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:18.468049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:18.478942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:18.480551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:18.490841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1171/2338] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:21.318340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:21.329076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615c69-6bb2-4de1-b8fc-e6a901b96801 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:21.333261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:21.334255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:21.334695 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:21.335299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:21.337648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:21.351239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:21.353527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:21.367758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1168/2339] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:38.576092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:38.577584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:38.592584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de951-01e5-4820-8552-d09396f29bf8 service placement] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:38.598121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:38.598754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:38.599035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:38.599332 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:38.601089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:38.614784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:38.616407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:38.627360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1172/2340] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:44.191923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.193587 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:44.258462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480607b-d11d-487d-ba1c-bec93083037a service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.262897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.264009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.264308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.264581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] PATH_INFO: `/v3/users/55f7b1ca4478415c9b526c4e4b9e3ca2` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.265799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f7b1ca4478415c9b526c4e4b9e3ca2)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.267735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.313841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f7b1ca4478415c9b526c4e4b9e3ca2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.314489 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f7b1ca4478415c9b526c4e4b9e3ca2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.325849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f7b1ca4478415c9b526c4e4b9e3ca2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.332322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f7b1ca4478415c9b526c4e4b9e3ca2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.332946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-31c8df78-8127-472c-bca8-b62ffecdb5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f7b1ca4478415c9b526c4e4b9e3ca2'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.345027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1169/2341] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:44:44 2022] DELETE /identity/v3/users/55f7b1ca4478415c9b526c4e4b9e3ca2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:44:44.516490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.527545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513edd3-740e-4f3b-bdbe-012d45aff13e service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.585070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.585928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.586203 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.586472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] PATH_INFO: `/v3/projects/05347ecf2f1e4379bfa0f96c9df28c9c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.587679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05347ecf2f1e4379bfa0f96c9df28c9c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.590089 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.636072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05347ecf2f1e4379bfa0f96c9df28c9c', 'request_id': 'req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.641220 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05347ecf2f1e4379bfa0f96c9df28c9c', 'request_id': 'req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.647015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05347ecf2f1e4379bfa0f96c9df28c9c', 'request_id': 'req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.661044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] The token cache is being invalidate because project 05347ecf2f1e4379bfa0f96c9df28c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:44:44.661328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.661938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-19935455-d11a-40ce-a8cf-ed9bd2dfca5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:44:44.663500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1173/2342] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:44:44 2022] DELETE /identity/v3/projects/05347ecf2f1e4379bfa0f96c9df28c9c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:44:44.669165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.669455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.669730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.686633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:44.687883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:44.744429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1170/2343] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:44.751867 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.752159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.752456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.770294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:44.771433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:44.779714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1174/2344] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:44.783893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.793773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06057d-a869-44f9-b6be-a0a455b23090 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.798253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.798892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.799173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.799475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.800187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:44:44.800495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.802069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.813073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1171/2345] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:44:44.817287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.827051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc86d-05ff-473e-97b3-fc320b2e69d2 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.831824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.832464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.832770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.833041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.833729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.835657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.860598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1175/2346] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:44:44 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:44:44.864623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.874301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82656-37f4-40db-b824-b05238419d2c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.927790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.928453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.928735 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.929010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.929688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.931620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.951071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1172/2347] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:44:44 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:44:44.955142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.965749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9f74-d909-4ec5-bba1-53fe8e753864 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:44.970313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:44.970951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:44.971228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:44.971524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:44.972239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:44.973805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:44.984139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1176/2348] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:44:44.987952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:44.997926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbfc66-f4bd-4048-9685-e6613517248c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:45.002597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:45.003243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:45.003553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:45.003825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:45.004531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:45.006094 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e274d8-16a8-46e8-bb48-d3cf33a36dd5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:45.016087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1173/2349] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:44:45.020008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:45.030308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a8e-20cc-4074-8761-759477949396 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:45.034905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:45.035804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:45.036085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:45.036360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] PATH_INFO: `/v3/projects/ee00a37abf8a49eba7d06738e181eb4b/users/bd7b114dcefa4088851a61b3c7283b21/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:45.050090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee00a37abf8a49eba7d06738e181eb4b, user_id=bd7b114dcefa4088851a61b3c7283b21, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:45.052770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:45.064871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1177/2350] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:44:45 2022] PUT /identity/v3/projects/ee00a37abf8a49eba7d06738e181eb4b/users/bd7b114dcefa4088851a61b3c7283b21/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:44:45.069734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be082f6-992c-44a1-a9b8-49b4da49f4fa None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:45.070026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be082f6-992c-44a1-a9b8-49b4da49f4fa None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:45.070309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be082f6-992c-44a1-a9b8-49b4da49f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:45.088188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0be082f6-992c-44a1-a9b8-49b4da49f4fa None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:45.089961 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0be082f6-992c-44a1-a9b8-49b4da49f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:45.144854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1174/2351] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:45.154822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:45.156498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:45.211579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e18d1-e743-4228-94a9-0a26a338870f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:45.215164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:45.215824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:45.216101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:45.216374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:45.225081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:45.226500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:45.235656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1178/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:49.273180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.273721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.273817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.300688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] MFA Rules not processed for user `bd7b114dcefa4088851a61b3c7283b21`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:49.301903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:49.369074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1175/2353] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:49.374188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.383941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8a5a-cbe8-41a1-8257-5d4b46621bff service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.388603 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.389474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.389763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.390038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.390730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.392656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.419637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1179/2354] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:44:49.423706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.437749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62383-c854-4396-a19f-5edfd86f7cdb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.497311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.497984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.498326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.498517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.499213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.501173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.524759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1176/2355] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:44:49 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:44:49.528935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.544198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27588c-72d4-41d8-9969-b801016b832c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.548780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.549445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.549725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.549995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.550740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.552411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.565864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1180/2356] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:44:49.568537 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.579725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04d06-25d5-4350-810e-7d4df18c99ba admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.584440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.585326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.585607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.585882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] PATH_INFO: `/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172/users/6014c95eee3841c8b5169246555009b9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.602309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d1f49a17b6456ebc79bcd41fd27172, user_id=6014c95eee3841c8b5169246555009b9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.605036 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.620061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1177/2357] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:44:49 2022] PUT /identity/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172/users/6014c95eee3841c8b5169246555009b9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:44:49.624179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.634595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c27a-2508-48cc-87f3-1bf1bd5a9bd8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.692739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.693407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.693691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.693945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.694671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.696336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226288e8-21ee-48b7-a006-5e2abf0e4518 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.710340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1181/2358] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:44:49.711521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:49.722607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113ccd-fc3e-4826-ace5-91a698e362b6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:49.727635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:49.728545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:49.728824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:49.729093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] PATH_INFO: `/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172/users/6014c95eee3841c8b5169246555009b9/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:49.731642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d1f49a17b6456ebc79bcd41fd27172, user_id=6014c95eee3841c8b5169246555009b9, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:49.734300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:49.747542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1178/2359] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:44:49 2022] PUT /identity/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172/users/6014c95eee3841c8b5169246555009b9/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:44:54.175665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bf81-69d5-48cb-b477-c0a1a7fee2df None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:54.176206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bf81-69d5-48cb-b477-c0a1a7fee2df None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:54.176407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bf81-69d5-48cb-b477-c0a1a7fee2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:54.204336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e945bf81-69d5-48cb-b477-c0a1a7fee2df None None] MFA Rules not processed for user `6014c95eee3841c8b5169246555009b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:54.205538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e945bf81-69d5-48cb-b477-c0a1a7fee2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:54.273988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1182/2360] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:44:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:44:54.286186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:54.288068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:54.346280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee4f0-76bb-4157-9fb1-5e5f40045861 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:54.349757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:54.350385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:54.350666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:54.350934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:54.408898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:54.410357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:54.420142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1179/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:44:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:44:54.523171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b380-8398-46dc-8faf-8fda2a14c731 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:54.523492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b380-8398-46dc-8faf-8fda2a14c731 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:54.523965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b380-8398-46dc-8faf-8fda2a14c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:54.541499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-29b6b380-8398-46dc-8faf-8fda2a14c731 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:44:54.543424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-29b6b380-8398-46dc-8faf-8fda2a14c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:54.604592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1183/2362] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:44:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:44:54.657778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:44:54.659341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:44:54.736629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bcea2-918b-4d2b-baa1-487347e5dfa1 service glance] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:44:54.741698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:44:54.742353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:44:54.742773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:44:54.743047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:44:54.752425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:44:54.754046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:44:54.768918 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1180/2363] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:44:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:45:03.647734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c882-070a-4ee7-8510-b7d0ed9e6df5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:03.648198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c882-070a-4ee7-8510-b7d0ed9e6df5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:03.648313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c882-070a-4ee7-8510-b7d0ed9e6df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:03.667871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6c73c882-070a-4ee7-8510-b7d0ed9e6df5 None None] MFA Rules not processed for user `bd7b114dcefa4088851a61b3c7283b21`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:03.669169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6c73c882-070a-4ee7-8510-b7d0ed9e6df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:03.676106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1184/2364] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:45:03.917858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:03.970072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1a36b-2404-4d70-920e-b14e75f52743 service swift] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:03.973616 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:03.974381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:03.974656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:03.974923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:03.976664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:03.985813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:03.987233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:03.995656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1181/2365] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:45:07.214820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:07.215881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:07.216373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:07.237407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:07.239175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:07.262327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1185/2366] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:45:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:45:07.262892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:07.275349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f535f-4796-44e9-bb65-56c2500aba07 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:07.282040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:07.282986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:07.283483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:07.283939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:07.294716 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:07.296878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:07.306921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1182/2367] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 06:45:08.589849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:08.595588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:08.757643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5447-2ec9-4fa4-82db-90a5e54df693 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:08.769254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:08.771554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:08.772064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:08.773050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:08.777972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:08.805775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:08.811456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:08.846067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1186/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:45:22.138606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:22.152512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5557-80fc-4ec4-bbdd-db32d78230b9 service swift] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:22.158263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:22.158907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:22.159189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:22.159498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:22.161259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:22.173404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:22.174897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:22.186615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1183/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:45:33.027512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:33.043102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9c58-ce08-479c-85fd-e6ed2c2838aa service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:33.046773 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:33.047452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:33.047737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:33.048005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:33.050278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:33.113520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:33.114951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595572f-cfa8-4eef-86e8-b4d3a91e5474 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:33.125392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1187/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:45:37.425754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:37.428095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:37.438814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:37.439314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:37.439494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:37.446568 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2d8c-983a-45c5-9d36-a007902c70c0 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:37.453393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:37.454265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:37.454731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:37.455160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] PATH_INFO: `/v3/users/0334273a56994a7abfa3d72006f7a7a4` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:37.456545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0334273a56994a7abfa3d72006f7a7a4)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:37.458747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:37.458881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] MFA Rules not processed for user `e57cd656669e42bea86c8206b333bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:37.460200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:37.518390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0334273a56994a7abfa3d72006f7a7a4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.519031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0334273a56994a7abfa3d72006f7a7a4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.521327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1188/2371] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:45:37.531960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0334273a56994a7abfa3d72006f7a7a4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.538758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0334273a56994a7abfa3d72006f7a7a4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.539495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0334273a56994a7abfa3d72006f7a7a4'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.555258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1184/2372] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:45:37 2022] DELETE /identity/v3/users/0334273a56994a7abfa3d72006f7a7a4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:45:37.740865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:37.753068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d2d48-5771-4243-a6f7-97d6f6523526 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:37.831438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:37.832750 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:37.833241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:37.833698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] PATH_INFO: `/v3/projects/0d1689ff62644e0c92c3bf8290b52b90` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:37.835405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1689ff62644e0c92c3bf8290b52b90)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:37.837606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:37.896590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1689ff62644e0c92c3bf8290b52b90', 'request_id': 'req-9cc136bd-af77-44db-b24b-cb4eb104181c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.902794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1689ff62644e0c92c3bf8290b52b90', 'request_id': 'req-9cc136bd-af77-44db-b24b-cb4eb104181c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.909747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1689ff62644e0c92c3bf8290b52b90', 'request_id': 'req-9cc136bd-af77-44db-b24b-cb4eb104181c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.914492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:37.916650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:37.925753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] The token cache is being invalidate because project 0d1689ff62644e0c92c3bf8290b52b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:45:37.926173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.926944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9cc136bd-af77-44db-b24b-cb4eb104181c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:45:37.929071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1189/2373] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:45:37 2022] DELETE /identity/v3/projects/0d1689ff62644e0c92c3bf8290b52b90 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:45:37.934753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2096c8-4e9b-4d86-8fd2-5032751e6d2a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:37.935040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2096c8-4e9b-4d86-8fd2-5032751e6d2a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:37.935508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2096c8-4e9b-4d86-8fd2-5032751e6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:37.955172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-0e2096c8-4e9b-4d86-8fd2-5032751e6d2a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:37.956413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0e2096c8-4e9b-4d86-8fd2-5032751e6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:37.980372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecde392-c334-4fdc-adbd-3add81e288cc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.021134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1190/2374] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:45:38.028490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.028770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.029472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.045028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.045747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.046170 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.046504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.049100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.061024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:38.062116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.062233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.064211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.071807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1191/2375] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:45:38.074136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1185/2376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:45:38.076340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.085611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38cd2a-9fb7-48f8-88d6-a2e68f98b4f8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.090688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.091396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.091681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.092052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.092671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:45:38.093169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.094760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.120143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1192/2377] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:45:38.122145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.134329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3589d4-62f9-4cbc-8341-811252dde8a7 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.139775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.140582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.141136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.141513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.142898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.145265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.194888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1186/2378] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:45:38 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:45:38.196488 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.206791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cee8-126a-4ff5-ab6d-1831fee80b98 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.282574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.283293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.283592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.283866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.284563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.286475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.306344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1193/2379] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:45:38 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:45:38.310668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.320983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee33f-c88a-404f-ba0c-5b00b2269e7b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.326779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.327475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.327780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.328054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.328799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.330415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.344104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1187/2380] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:45:38.345614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.356981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870601b-4f1c-4452-a130-8bba1b556d01 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.362177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.362859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.363136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.363453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.364172 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.365755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.377717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1194/2381] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:45:38.382120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.393470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eebefd-539d-4e92-a965-6d558b3a6d0c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.403736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.404901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.405723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.405723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] PATH_INFO: `/v3/projects/ec5def7947c243698109bfc891b0992f/users/4974777a05b64dbcb3550b74b9f39dee/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.412767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.414538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.423636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5def7947c243698109bfc891b0992f, user_id=4974777a05b64dbcb3550b74b9f39dee, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.426541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6e647-2d2d-435d-a5c7-7f1c32ca2f1a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.441923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1188/2382] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:45:38 2022] PUT /identity/v3/projects/ec5def7947c243698109bfc891b0992f/users/4974777a05b64dbcb3550b74b9f39dee/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:45:38.446789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.447124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.447481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.467718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:38.468969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.496585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2ca2-46c7-43e0-b146-be0a7fd8b0bd admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.540514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1189/2383] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:45:38.551795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:38.553419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.558086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.559376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.559665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.559935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.563077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:38.566428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087a39-26ea-4047-853b-1d332e193d85 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:38.571498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:38.572251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:38.573389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:38.573671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:38.586161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.588263 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaaaae-6bcf-4e0c-bb75-a11703278727 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.598481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1190/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:45:38.635767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:38.637215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:38.647302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1195/2385] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:45:44.926938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e7f3-47ed-4a02-b957-a0bc6138c26e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:44.927545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e7f3-47ed-4a02-b957-a0bc6138c26e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:44.928024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e7f3-47ed-4a02-b957-a0bc6138c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:44.948782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c6d0e7f3-47ed-4a02-b957-a0bc6138c26e None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:44.950188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c6d0e7f3-47ed-4a02-b957-a0bc6138c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:45.022069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1191/2386] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:45:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:45:45.036181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:45.038092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:45.146153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc3fa4-fae4-4ad1-9380-d221dd8cca2a service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:45.152194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:45.152865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:45.153169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:45.153690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:45.163372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:45.165166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:45.175352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1196/2387] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:45:46.508319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417b5-deca-4b5a-a898-7ffecce9b975 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:46.509861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417b5-deca-4b5a-a898-7ffecce9b975 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:46.510364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417b5-deca-4b5a-a898-7ffecce9b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:46.562016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f47417b5-deca-4b5a-a898-7ffecce9b975 None None] MFA Rules not processed for user `4974777a05b64dbcb3550b74b9f39dee`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:46.563644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f47417b5-deca-4b5a-a898-7ffecce9b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:46.687730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1192/2388] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:45:46.702572 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:45:46.705031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:46.820147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a900b-f228-4cf4-8e63-eb0388972803 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:45:46.834131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:45:46.834959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:46.835244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:46.835544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:46.854558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:45:46.858496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca3d01-3200-4545-9764-52693dbdd4f8 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:45:46.885930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1197/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:45:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:45:49.112492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a332-c443-4f5f-8210-0028538f7ca4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:45:49.112996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a332-c443-4f5f-8210-0028538f7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:45:49.113087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a332-c443-4f5f-8210-0028538f7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:45:49.138038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2179a332-c443-4f5f-8210-0028538f7ca4 None None] MFA Rules not processed for user `4974777a05b64dbcb3550b74b9f39dee`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:45:49.139300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2179a332-c443-4f5f-8210-0028538f7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:45:49.149864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1193/2390] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:45:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:02.200863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.201549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.201549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.203411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1198/2391] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:02.209765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3d8e-a26c-4c72-971b-a7c95719d3e2 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.210286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3d8e-a26c-4c72-971b-a7c95719d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.210286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3d8e-a26c-4c72-971b-a7c95719d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.228344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-d03a3d8e-a26c-4c72-971b-a7c95719d3e2 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:02.230187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d03a3d8e-a26c-4c72-971b-a7c95719d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:02.239621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1194/2392] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:02.251970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:02.253704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:02.314768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d509b-7dd0-41ca-a86f-4a013ac48124 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:02.318474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a776f52df1c944ed9b28524b7c582e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:02.319193 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.319577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.319919 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.331141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:02.332620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506ff8-2253-4286-9835-3483cd3670f5 service glance] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:02.343995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1199/2393] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:02.412528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea4d2-2975-47aa-8a8f-338cc105d2ba None None] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.412834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea4d2-2975-47aa-8a8f-338cc105d2ba None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.413103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea4d2-2975-47aa-8a8f-338cc105d2ba None None] PATH_INFO: `/` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.414479 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1195/2394] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:02.419358 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882cc7-e4b3-4023-8e5c-128d83109797 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.419644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882cc7-e4b3-4023-8e5c-128d83109797 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.419917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882cc7-e4b3-4023-8e5c-128d83109797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.439381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3d882cc7-e4b3-4023-8e5c-128d83109797 None None] MFA Rules not processed for user `a37ec62dd1334df8b9870c43c609aac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:02.440558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3d882cc7-e4b3-4023-8e5c-128d83109797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:02.447235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1200/2395] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:46:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:02.459544 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea4d2-2975-47aa-8a8f-338cc105d2ba None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:02.470284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea4d2-2975-47aa-8a8f-338cc105d2ba None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:02.473843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:02.474494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.474778 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.475048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.482693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:02.484132 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e5ddf-2409-4429-aad7-714278d69ce6 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:02.491875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1196/2396] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:46:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:02.575918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89da33-2c2f-4258-86c3-133827ede577 None None] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.576199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89da33-2c2f-4258-86c3-133827ede577 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.576543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89da33-2c2f-4258-86c3-133827ede577 None None] PATH_INFO: `/` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.577898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1201/2397] 10.222.0.64 () {54 vars in 921 bytes} [Wed May 11 06:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 06:46:02.583352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77e56-ef77-46e3-b158-24a648acebf9 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.583666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77e56-ef77-46e3-b158-24a648acebf9 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.583941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77e56-ef77-46e3-b158-24a648acebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.601474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2ec77e56-ef77-46e3-b158-24a648acebf9 None None] MFA Rules not processed for user `d8526efe49fd469bb829106580483ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:02.602663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2ec77e56-ef77-46e3-b158-24a648acebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:02.611828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1197/2398] 10.222.0.64 () {58 vars in 1018 bytes} [Wed May 11 06:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:46:02.623008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89da33-2c2f-4258-86c3-133827ede577 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:02.634047 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89da33-2c2f-4258-86c3-133827ede577 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:02.638303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:02.638977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:02.639329 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:02.639608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:02.649932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:02.652003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:02.662705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1202/2399] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:46:05.568967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31a3f-3366-462c-b793-6a90ca09b124 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:05.569464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31a3f-3366-462c-b793-6a90ca09b124 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:05.569559 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31a3f-3366-462c-b793-6a90ca09b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:05.590372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-43d31a3f-3366-462c-b793-6a90ca09b124 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:05.591632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-43d31a3f-3366-462c-b793-6a90ca09b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:05.598688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1198/2400] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:46:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:05.611881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:05.624321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806141f-a0c5-48e5-9f89-9c15469569ca service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:05.629132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921172-75da-4f9c-b650-e1508995622d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:05.629760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921172-75da-4f9c-b650-e1508995622d service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:05.630037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921172-75da-4f9c-b650-e1508995622d service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:05.630307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921172-75da-4f9c-b650-e1508995622d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:05.639472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67921172-75da-4f9c-b650-e1508995622d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:05.641032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67921172-75da-4f9c-b650-e1508995622d service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:05.649656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1203/2401] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:46:23.307189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:23.307833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:23.307833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:23.326032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:46:23.327224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:46:23.340985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1199/2402] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:46:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:46:23.348483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921172-75da-4f9c-b650-e1508995622d service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:46:23.359383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921172-75da-4f9c-b650-e1508995622d service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:46:23.364706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:46:23.365470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:46:23.365844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:46:23.366174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:46:23.375228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:46:23.376950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:46:23.385699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1204/2403] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:47:01.472705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:01.482126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb308d-5a5c-4171-978a-142db91e81d0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:01.485713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:01.486358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:01.486640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:01.486914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:01.488767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:01.500632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:01.502039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:01.512023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1200/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:05.028597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.030412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.048324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffef5-de2e-4113-b3bf-e5d1454e7fc9 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.052923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.053794 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.054076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.054347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] PATH_INFO: `/v3/users/e57cd656669e42bea86c8206b333bd6d` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.055591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57cd656669e42bea86c8206b333bd6d)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.057564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.103282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57cd656669e42bea86c8206b333bd6d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.104623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57cd656669e42bea86c8206b333bd6d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.120461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57cd656669e42bea86c8206b333bd6d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.126871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57cd656669e42bea86c8206b333bd6d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.134899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57cd656669e42bea86c8206b333bd6d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.140796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1205/2405] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:05 2022] DELETE /identity/v3/users/e57cd656669e42bea86c8206b333bd6d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:05.232092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.233488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.301881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704f0a-c49d-463d-9dbb-94fe9c5a008f service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.321062 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.323112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.379757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.380963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.381431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.381709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.383541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.390839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e25ca-53e3-4e42-a048-12e3fccab9b4 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.395458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.395596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.396445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.396720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.396988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] PATH_INFO: `/v3/projects/eb4348f294cc464f89b2334676442d25` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.397099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbdf2-5155-4af6-9b51-b943b889b3f9 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.398149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4348f294cc464f89b2334676442d25)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.400667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.408125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1201/2406] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:05.452348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4348f294cc464f89b2334676442d25', 'request_id': 'req-f683a717-29ce-4eb0-8990-67d60f3c0e77'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.457634 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4348f294cc464f89b2334676442d25', 'request_id': 'req-f683a717-29ce-4eb0-8990-67d60f3c0e77'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.465475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4348f294cc464f89b2334676442d25', 'request_id': 'req-f683a717-29ce-4eb0-8990-67d60f3c0e77'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.478384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] The token cache is being invalidate because project eb4348f294cc464f89b2334676442d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:05.478671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.479322 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-f683a717-29ce-4eb0-8990-67d60f3c0e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:05.481175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1206/2407] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:05 2022] DELETE /identity/v3/projects/eb4348f294cc464f89b2334676442d25 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:05.486140 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.486425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.486698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.505324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:05.506680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.568021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1202/2408] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:05.576442 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.576728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.577002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.596436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:05.597715 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:05.605718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1207/2409] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:05.609957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.619613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa00c6-0d9c-440d-a8f4-08aaf2445556 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.624943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.625684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.626035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.626308 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.627023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:05.627357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.628928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.640715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1203/2410] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:05.644863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.654406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050182a0-db8c-454b-b79a-e1a39f7fff56 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.658934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.659597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.659873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.660142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.660827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.662707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.688032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1208/2411] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:05 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:05.691851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.702343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0fd5b-1d8a-4d4f-a05f-0f2f98763422 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.758651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.759345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.759629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.759911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.760599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.762499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.787629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1204/2412] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:05 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:05.789002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.799952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340035-d7d1-4c2f-9f0f-fe7f8ae86cde admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.804537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.805181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.805483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.806376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.807102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.808729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.818821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1209/2413] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:05.822751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.832806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030205-fa62-44f2-8977-c4210867eb73 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.837952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.838603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.838885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.839162 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.839936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.841516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385c8f-5729-4fda-a3dd-496642b6c408 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.851483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1205/2414] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:05.856190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:05.865709 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced437-c011-4236-bb02-60ab5e05e497 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:05.870252 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:05.871107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.871544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.871815 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] PATH_INFO: `/v3/projects/a1362429610343c29ee07c6beef05ec9/users/98ecd66e99a744f698061d30799dfbb8/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.886682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1362429610343c29ee07c6beef05ec9, user_id=98ecd66e99a744f698061d30799dfbb8, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:05.889330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:05.902640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1210/2415] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:05 2022] PUT /identity/v3/projects/a1362429610343c29ee07c6beef05ec9/users/98ecd66e99a744f698061d30799dfbb8/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:05.912665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:05.912952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:05.913231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:05.941144 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] MFA Rules not processed for user `98ecd66e99a744f698061d30799dfbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:05.942405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:06.009602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1206/2416] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:06.014230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.078861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962537-7d05-4634-b930-fd118f3511c3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.083704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.084482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.084903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.085231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.085977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.088120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.117191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1211/2417] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:06 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:06.119117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.129960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c9309-d626-41c7-97cf-9f2df1cda3bb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.216480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.217437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.218645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.218867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.219857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.221993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.255822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1207/2418] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:06 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:06.257104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.268573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789f3e4-28eb-4b6c-9f02-9d3c8f3b3765 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.273758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.274635 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.278981 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.279461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.280544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.282530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.295419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1212/2419] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:06.299903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.310607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251a6c-f63a-4f43-aeec-53a87df450d6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.315629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.316719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.317168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.317442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] PATH_INFO: `/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095/users/0006c2fa0bd94c6a89824cf338ed472b/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.334456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0c9b7ec87e4d0081a0d6813aa55095, user_id=0006c2fa0bd94c6a89824cf338ed472b, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.337158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.352449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1208/2420] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:06 2022] PUT /identity/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095/users/0006c2fa0bd94c6a89824cf338ed472b/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:06.357007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.366747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39bb2-229b-4080-b2bd-703bd932cb62 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.425716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.426392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.426672 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.426945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.427706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.429330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae0534-5d95-4882-a8a9-f1b5e867029f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.439460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1213/2421] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:06.443673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.454065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669275-1a64-4085-a85f-62d36973862a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.458566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.459460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.459734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.459997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] PATH_INFO: `/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095/users/0006c2fa0bd94c6a89824cf338ed472b/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.461943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0c9b7ec87e4d0081a0d6813aa55095, user_id=0006c2fa0bd94c6a89824cf338ed472b, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.464578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.474113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1209/2422] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:06 2022] PUT /identity/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095/users/0006c2fa0bd94c6a89824cf338ed472b/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:06.485490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.485807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.486106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.512024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] MFA Rules not processed for user `0006c2fa0bd94c6a89824cf338ed472b`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:06.513221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:06.577948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1214/2423] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:06.589867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:06.591496 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:06.649091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7cef4-c1a6-45bf-b2f9-92442449e566 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:06.653480 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:06.654158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:06.654443 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:06.654720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:06.664709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:06.666759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2c61-9403-4521-90d8-dd392377eef1 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:06.677380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1210/2424] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:07.059077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:07.124769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90e90-f344-4be8-a9f1-06592beaff07 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:07.129313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:07.130174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:07.130452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:07.130727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] PATH_INFO: `/v3/users/98ecd66e99a744f698061d30799dfbb8` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:07.131900 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ecd66e99a744f698061d30799dfbb8)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:07.133831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:07.177047 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ecd66e99a744f698061d30799dfbb8'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:07.177690 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ecd66e99a744f698061d30799dfbb8'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:07.189460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ecd66e99a744f698061d30799dfbb8'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:07.195926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ecd66e99a744f698061d30799dfbb8'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:07.202949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ecd66e99a744f698061d30799dfbb8'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:07.208734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1215/2425] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:07 2022] DELETE /identity/v3/users/98ecd66e99a744f698061d30799dfbb8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:07.213848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:07.214136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:07.214413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:07.232148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:07.233333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:07.289062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1211/2426] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:07.298683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:07.300134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:07.361475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df50eeb-448e-4155-8f08-0925332d36f8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:07.365128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:07.365761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:07.366038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:07.366309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:07.375686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:07.377050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:07.386703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1216/2427] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:08.131196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:08.132706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:08.145367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb628fb-084a-48c8-aacd-f0e5e98ec661 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:08.161571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:08.162719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:08.163536 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:08.164008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] PATH_INFO: `/v3/projects/a1362429610343c29ee07c6beef05ec9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:08.165661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1362429610343c29ee07c6beef05ec9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:08.167930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:08.234462 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1362429610343c29ee07c6beef05ec9', 'request_id': 'req-4126229b-a8d7-4073-9d64-4e51edfcbbe8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.243045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1362429610343c29ee07c6beef05ec9', 'request_id': 'req-4126229b-a8d7-4073-9d64-4e51edfcbbe8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.249440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1362429610343c29ee07c6beef05ec9', 'request_id': 'req-4126229b-a8d7-4073-9d64-4e51edfcbbe8'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.261326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] The token cache is being invalidate because project a1362429610343c29ee07c6beef05ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:08.261663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.262279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.264120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1212/2428] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:08 2022] DELETE /identity/v3/projects/a1362429610343c29ee07c6beef05ec9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:08.267818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:08.277516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254e1e-0e92-4165-9846-1decc483f33c service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:08.342416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:08.343325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:08.343611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:08.343886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] PATH_INFO: `/v3/users/0006c2fa0bd94c6a89824cf338ed472b` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:08.345165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0006c2fa0bd94c6a89824cf338ed472b)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:08.347524 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:08.401299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0006c2fa0bd94c6a89824cf338ed472b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.401983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0006c2fa0bd94c6a89824cf338ed472b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.414446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0006c2fa0bd94c6a89824cf338ed472b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.422674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0006c2fa0bd94c6a89824cf338ed472b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.431862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-33f64c97-b242-424f-8437-3f270add2ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0006c2fa0bd94c6a89824cf338ed472b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.438430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1217/2429] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:08 2022] DELETE /identity/v3/users/0006c2fa0bd94c6a89824cf338ed472b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:08.717182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:08.718754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:08.738844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126229b-a8d7-4073-9d64-4e51edfcbbe8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:08.808343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:08.809221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:08.809506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:08.809781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] PATH_INFO: `/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:08.811038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0c9b7ec87e4d0081a0d6813aa55095)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:08.812980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:08.875180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0c9b7ec87e4d0081a0d6813aa55095', 'request_id': 'req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.888091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0c9b7ec87e4d0081a0d6813aa55095', 'request_id': 'req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.895323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0c9b7ec87e4d0081a0d6813aa55095', 'request_id': 'req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.916463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] The token cache is being invalidate because project fc0c9b7ec87e4d0081a0d6813aa55095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:08.916801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.917519 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d8f3f4f9-c25d-43c4-b0d9-69aee53ee511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:08.919375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1213/2430] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:08 2022] DELETE /identity/v3/projects/fc0c9b7ec87e4d0081a0d6813aa55095 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:08.924258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:08.924550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:08.924846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:08.954692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:08.956645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:09.039647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1218/2431] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:09.048010 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.048398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.048744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.080819 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:09.082817 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:09.096116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1214/2432] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:09.097570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.107826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2de5-9b7f-488a-8075-fe55148d0046 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.113941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.114586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.114866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.115237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.116004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:09.116606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.119083 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.143060 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1219/2433] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:09.143754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.154520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e17259-b48e-400c-a337-9fe5f0b7d196 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.161748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.162570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.162862 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.163136 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.163905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.166043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.193255 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1215/2434] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:09.197765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.209526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0bd1-f3cc-4ad1-b20b-5047099651f7 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.287048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.289082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.289082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.289082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.289082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.292611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.319053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1220/2435] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/users => generated 278 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:09.320657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.333472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5f0d-e4d3-44f2-b57a-ae4071b2a483 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.339911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.341125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.341577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.342012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.342744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.344972 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.356980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1216/2436] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:09.361107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.373936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e64d-f7e7-480e-8f92-3f276885a65f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.379082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.379724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.379964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.380242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.380971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.382568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c19887-a437-4c0c-8cca-d96f9ba2ddaa admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.397802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1221/2437] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:09.400079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.410424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfba7-3093-46bf-a69b-a60b1fbbacd6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.415063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.415976 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.416254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.416527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] PATH_INFO: `/v3/projects/4bb1ecb3873e4fa895db4c27e4f658aa/users/7ef55c51178f4f1380eab7a90f8bfb5d/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.432647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb1ecb3873e4fa895db4c27e4f658aa, user_id=7ef55c51178f4f1380eab7a90f8bfb5d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.435506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.449525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1217/2438] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:09 2022] PUT /identity/v3/projects/4bb1ecb3873e4fa895db4c27e4f658aa/users/7ef55c51178f4f1380eab7a90f8bfb5d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:09.459765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.460055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.460331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.486351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] MFA Rules not processed for user `7ef55c51178f4f1380eab7a90f8bfb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:09.487686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:09.555128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1222/2439] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:09.559939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.630740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b380-122c-4246-a16e-c907b4a1d18c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.638760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.639900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.640330 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.640947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.641788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.644580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.674179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1218/2440] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:09.678497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.694159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c56f5-0a2c-4d60-9248-0e3ae3325f82 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.752014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.752699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.752982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.753286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.753967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.755956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.781073 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1223/2441] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:09 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:09.785141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.796794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d817-05e7-411f-99d7-dfd7d749d9c7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.801739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.802437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.802777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.802960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.803733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.805328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.816313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1219/2442] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:09.820584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.831785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbbc5a-3ead-4e5a-ba1a-ccf184627b51 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.836798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.838366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.838722 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.839069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] PATH_INFO: `/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e/users/623722ba42bb4b428b859027d1c61913/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.854751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dd7b5c4a1e4fdc864f0b0989fc541e, user_id=623722ba42bb4b428b859027d1c61913, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.857446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.869805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1224/2443] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:09 2022] PUT /identity/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e/users/623722ba42bb4b428b859027d1c61913/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:09.873884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.884198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a53a7-349e-4e68-aa59-03a9160b30e8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.941958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.942642 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.942920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.943189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.943944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.945529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aca25a-66cc-4ac0-9cf2-3bf82d3bc8bd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.959383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1220/2444] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:09.961079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:09.971405 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c032-2f82-4cab-907a-fa39e943a6ba admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:09.976126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:09.977010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:09.977290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:09.978111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] PATH_INFO: `/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e/users/623722ba42bb4b428b859027d1c61913/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:09.980374 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dd7b5c4a1e4fdc864f0b0989fc541e, user_id=623722ba42bb4b428b859027d1c61913, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:09.983023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:09.995370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1225/2445] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:09 2022] PUT /identity/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e/users/623722ba42bb4b428b859027d1c61913/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:10.005424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:10.005805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:10.006146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:10.032648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] MFA Rules not processed for user `623722ba42bb4b428b859027d1c61913`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:10.033934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:10.103734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1221/2446] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:10.116862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:10.119359 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:10.185035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fd25-e34a-4931-995e-e3afa882e1a6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:10.188685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:10.189324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:10.189600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:10.189866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:10.199365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:10.200797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:10.210174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1226/2447] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:10.283789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:10.293967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a655fc9-40ef-4305-8247-877d1842810b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:10.297731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:10.298376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:10.298655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:10.298957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:10.363826 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:10.365343 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:10.375101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1222/2448] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:10 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:13.207114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:13.208511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:13.262406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107fa3-5d96-4ed3-b7a1-f8866a0586f1 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:13.265951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:13.266584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:13.266862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:13.267133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:13.268899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:13.327769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:13.329218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:13.339102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1227/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:16.716201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:16.718241 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:16.734254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2721231-a7d8-48f5-ab14-34134fb161fe service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:16.738870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:16.740030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:16.740490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:16.740933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] PATH_INFO: `/v3/users/1f2d12e60ae147198c3940c510616285` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:16.745211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2d12e60ae147198c3940c510616285)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:16.746534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:16.793547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2d12e60ae147198c3940c510616285'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:16.794317 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2d12e60ae147198c3940c510616285'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:16.807812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2d12e60ae147198c3940c510616285'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:16.816365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2d12e60ae147198c3940c510616285'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:16.817504 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-42f92511-485d-4bb9-95d8-cfee13895078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2d12e60ae147198c3940c510616285'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:16.835878 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1223/2450] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:16 2022] DELETE /identity/v3/users/1f2d12e60ae147198c3940c510616285 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:17.015477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.029134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e456d65-2d9b-438b-be74-f047a21cafce service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.099786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.099786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.099786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.099786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] PATH_INFO: `/v3/projects/ea42234bb6844ce88afe0725d859863e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.100158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea42234bb6844ce88afe0725d859863e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.100851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.153486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea42234bb6844ce88afe0725d859863e', 'request_id': 'req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:17.162186 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea42234bb6844ce88afe0725d859863e', 'request_id': 'req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:17.169922 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea42234bb6844ce88afe0725d859863e', 'request_id': 'req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:17.182811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] The token cache is being invalidate because project ea42234bb6844ce88afe0725d859863e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:17.183093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:17.183753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-eecd69b7-37b9-42bc-b5f9-d787ec41f1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:17.185568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1228/2451] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:17 2022] DELETE /identity/v3/projects/ea42234bb6844ce88afe0725d859863e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:17.191707 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.191999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.192256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.216660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:17.218053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:17.285849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1224/2452] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:17.294821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.295111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.295455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.314122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:17.315354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:17.324496 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1229/2453] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:17.328706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.338438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84935fc-117f-4047-ae31-d87dcaa82473 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.343023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.343931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.344218 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.344490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.345210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:17.345518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.347098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.358693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1225/2454] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:17.363012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.372805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b0b7-2aab-4c9d-ad5c-928b427e54eb None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.377797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.378454 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.378730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.378999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.379747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.381642 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.411831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1230/2455] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:17.412923 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.422734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1535-7bd7-489a-beb7-f38f6038d0f3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.483205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.483908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.484313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.484593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.485789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.487171 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.513721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1226/2456] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:17.518071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.528517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3e6f-1828-42f9-8d83-b6cd6e0e3e12 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.533523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.534364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.534768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.535162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.536640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.538331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.550708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1231/2457] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:17.555177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.565744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8a62-56b8-4209-8851-2adbdf830039 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.570459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.571306 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.571682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.572019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.572738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.574567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019997f6-0098-4a9c-8545-c5557602c1d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.587789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1227/2458] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:17.589056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.598902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5699e22-a90d-4d30-975a-89b999dc5931 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.604082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.605015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.605452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.605816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] PATH_INFO: `/v3/projects/4b502e1758fa4aec954bd7be16302d1f/users/ca1db01945a44065bb2d523a2e1a640c/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.621292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b502e1758fa4aec954bd7be16302d1f, user_id=ca1db01945a44065bb2d523a2e1a640c, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.623998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.638695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1232/2459] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:17 2022] PUT /identity/v3/projects/4b502e1758fa4aec954bd7be16302d1f/users/ca1db01945a44065bb2d523a2e1a640c/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:17.649054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.649353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.649635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.676026 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] MFA Rules not processed for user `ca1db01945a44065bb2d523a2e1a640c`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:17.677164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:17.753327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1228/2460] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:17.759637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.860894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb36d-b802-4672-ba8d-14a84bcfc887 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:17.870928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:17.871811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:17.872511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:17.872511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:17.873118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:17.875005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:17.917175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1233/2461] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:17.921352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:17.936112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe85e2-fbc4-460d-8d0a-76c8adcc80b7 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.003775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.005129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.005602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.005894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.006680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.010155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.038877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1229/2462] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:17 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:18.042792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:18.054082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0be9-f3a8-4fbe-844e-a3a464eae44d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.062209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.062997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.063278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.063569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.067235 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.076169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.091519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1234/2463] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:18.093322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:18.106629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bd45-080d-4691-ad84-6805304cbf6b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.111988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.113169 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.113561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.113953 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] PATH_INFO: `/v3/projects/f2b9c03c1c8d41c4af5385001e670397/users/e966cdcd45884574b67bfc02ac360f7f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.139347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b9c03c1c8d41c4af5385001e670397, user_id=e966cdcd45884574b67bfc02ac360f7f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.143084 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.181602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1230/2464] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:18 2022] PUT /identity/v3/projects/f2b9c03c1c8d41c4af5385001e670397/users/e966cdcd45884574b67bfc02ac360f7f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:18.182859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:18.201776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a6cd-05d1-4793-8a4c-e86488e48119 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.294876 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.295678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.296017 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.296351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.297162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.299035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74693-d0d0-41c0-999a-54436ae51d15 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.312108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1235/2465] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:18.316441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:18.330465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10b3b9-5402-47ca-8c68-4cb1bae82d7b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.335955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.336874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.337214 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.337472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] PATH_INFO: `/v3/projects/f2b9c03c1c8d41c4af5385001e670397/users/e966cdcd45884574b67bfc02ac360f7f/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.339495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b9c03c1c8d41c4af5385001e670397, user_id=e966cdcd45884574b67bfc02ac360f7f, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.342264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.355042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1231/2466] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:18 2022] PUT /identity/v3/projects/f2b9c03c1c8d41c4af5385001e670397/users/e966cdcd45884574b67bfc02ac360f7f/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:18.365028 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.365308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.365575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.399845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] MFA Rules not processed for user `e966cdcd45884574b67bfc02ac360f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:18.407511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:18.519930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1236/2467] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:18.533446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:18.535396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:18.663464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb24db2-25d4-45c0-a070-c1c1141aae16 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:18.667329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:18.669200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:18.669200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:18.669200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:18.691411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:18.693047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac5337-3334-4098-bc35-2a2ae1581af5 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:18.704694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1232/2468] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:18.948575 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:19.014180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3a0b9-d61f-4f42-bf37-74abd6c428df None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:19.019928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:19.021167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:19.021276 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:19.021534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] PATH_INFO: `/v3/users/ca1db01945a44065bb2d523a2e1a640c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:19.022729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1db01945a44065bb2d523a2e1a640c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:19.025221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:19.082195 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1db01945a44065bb2d523a2e1a640c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.082870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1db01945a44065bb2d523a2e1a640c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.099920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1db01945a44065bb2d523a2e1a640c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.107300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1db01945a44065bb2d523a2e1a640c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.119740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1db01945a44065bb2d523a2e1a640c'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.127139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1237/2469] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:18 2022] DELETE /identity/v3/users/ca1db01945a44065bb2d523a2e1a640c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:19.131535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:19.132025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:19.132124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:19.151393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:19.152613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:19.217779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1233/2470] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:19.229077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:19.231696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:19.294741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af749dff-b6df-41bd-933d-6f47a501686c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:19.298574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:19.299381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:19.299725 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:19.300063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:19.314104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:19.315994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:19.329597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1238/2471] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:19.810942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:19.812376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:19.826112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88373ce-a886-4d1b-bde3-2cfa6c6b79a1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:19.832954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:19.834004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:19.834444 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:19.834983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] PATH_INFO: `/v3/projects/4b502e1758fa4aec954bd7be16302d1f` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:19.838086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b502e1758fa4aec954bd7be16302d1f)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:19.840184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:19.895935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b502e1758fa4aec954bd7be16302d1f', 'request_id': 'req-81958403-50a0-48bf-a598-80d524e9cb00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.905713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b502e1758fa4aec954bd7be16302d1f', 'request_id': 'req-81958403-50a0-48bf-a598-80d524e9cb00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.911456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b502e1758fa4aec954bd7be16302d1f', 'request_id': 'req-81958403-50a0-48bf-a598-80d524e9cb00'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.923478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] The token cache is being invalidate because project 4b502e1758fa4aec954bd7be16302d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:19.923938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.924702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:19.926580 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1234/2472] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:19 2022] DELETE /identity/v3/projects/4b502e1758fa4aec954bd7be16302d1f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:19.930853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:19.942781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fef1-256b-4524-a84f-c629cf313b16 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:20.038704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:20.039703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:20.039956 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:20.040231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] PATH_INFO: `/v3/users/e966cdcd45884574b67bfc02ac360f7f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:20.045891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e966cdcd45884574b67bfc02ac360f7f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:20.048014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:20.107313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e966cdcd45884574b67bfc02ac360f7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.108109 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e966cdcd45884574b67bfc02ac360f7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.126822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e966cdcd45884574b67bfc02ac360f7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.136383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e966cdcd45884574b67bfc02ac360f7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.148456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-0105fe20-312f-4b87-ac30-d50f170f793b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e966cdcd45884574b67bfc02ac360f7f'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.166706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1239/2473] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:19 2022] DELETE /identity/v3/users/e966cdcd45884574b67bfc02ac360f7f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:20.730822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:20.732806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:20.755538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958403-50a0-48bf-a598-80d524e9cb00 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:20.860264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:20.861229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:20.862380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:20.862740 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] PATH_INFO: `/v3/projects/f2b9c03c1c8d41c4af5385001e670397` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:20.864926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b9c03c1c8d41c4af5385001e670397)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:20.868429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:20.926163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b9c03c1c8d41c4af5385001e670397', 'request_id': 'req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.933765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b9c03c1c8d41c4af5385001e670397', 'request_id': 'req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.939320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b9c03c1c8d41c4af5385001e670397', 'request_id': 'req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.953742 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] The token cache is being invalidate because project f2b9c03c1c8d41c4af5385001e670397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:20.954280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.954672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-28e7a1c1-3644-4ef9-8a3f-6cb1bf125d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:20.956240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1235/2474] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:20 2022] DELETE /identity/v3/projects/f2b9c03c1c8d41c4af5385001e670397 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:20.967532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:20.967532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:20.967532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:20.986006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:20.987209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:21.043362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1240/2475] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:21.052403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.052688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.052963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.070488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:21.071812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:21.079852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1236/2476] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:21.083780 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.093584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c85c5-813d-4466-b018-0e81e1392e3e None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.098132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.098772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.099063 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.099400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.100112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:21.100412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.102046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.114019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1241/2477] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:21.118419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.127483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c75958-4ef4-404f-b2cc-20a535d64ad0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.132155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.132800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.133099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.133359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.134055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.136005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.165755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1237/2478] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:21.170071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.180133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880cbcf-e797-4336-9733-66efba76c596 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.240023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.240767 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.241007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.241280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.241959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.243945 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.266513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1242/2479] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:21.267737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.278401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871daac-2056-4e74-9e3a-d087e9bc1c26 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.283982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.284679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.284960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.285228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.285960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.287576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.301182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1238/2480] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:21.305317 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.318150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12461d6a-b8d0-4908-978f-d36c39cd6f03 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.334052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.334741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.335019 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.335364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.336238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.338647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ef420-3263-4a13-89a2-6b4fe2c88de3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.352644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1243/2481] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:21.354058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.365248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273842-5651-42d5-8860-c4a128784ef6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.372905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.375552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.376023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.376658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] PATH_INFO: `/v3/projects/90a29284b5704576b29156dc5d712ce2/users/47e741bccb6a406388a830602e5f4815/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.396506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a29284b5704576b29156dc5d712ce2, user_id=47e741bccb6a406388a830602e5f4815, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.399722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.419368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1239/2482] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:21 2022] PUT /identity/v3/projects/90a29284b5704576b29156dc5d712ce2/users/47e741bccb6a406388a830602e5f4815/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:21.428187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.428499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.428802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.454994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] MFA Rules not processed for user `47e741bccb6a406388a830602e5f4815`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:21.456213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:21.516354 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1244/2483] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:21.520848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.579767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda21c2-3d19-4424-97ea-d18a8e2d518d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.584189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.584831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.585109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.585378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.586055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.588611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.613566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1240/2484] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:21.617808 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.629051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283a4d-8ffd-43d7-ac32-897c74b433c8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.681850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.682502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.682839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.683110 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.683805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.685687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.708490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1245/2485] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:21.709608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.720182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf9886-37b9-45e5-9c29-68b937eb9c67 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.724843 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.725500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.725783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.726068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.726775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.729039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.742398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1241/2486] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:21.744181 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.754357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16a4ce-993d-4f40-984d-8f28426cd741 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.759538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.760412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.760720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.760995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] PATH_INFO: `/v3/projects/edf65a7a28a042aba970cd1f9d808a26/users/ad1299ef55564e9da5a3b0c1c4733028/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.775657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf65a7a28a042aba970cd1f9d808a26, user_id=ad1299ef55564e9da5a3b0c1c4733028, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.778338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.791880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1246/2487] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:21 2022] PUT /identity/v3/projects/edf65a7a28a042aba970cd1f9d808a26/users/ad1299ef55564e9da5a3b0c1c4733028/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:21.795810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.806178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016151ad-b132-4350-b3ed-7d9726890771 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.862078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.862763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.863030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.863323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.864044 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.865615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a0e7-b1f4-4a22-b4d5-ab4424fe63a0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.875886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1242/2488] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:21.879937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:21.890326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a822-4901-4a82-ae7c-97ffc2b2cb68 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:21.894975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:21.895887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.896166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.896437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] PATH_INFO: `/v3/projects/edf65a7a28a042aba970cd1f9d808a26/users/ad1299ef55564e9da5a3b0c1c4733028/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.898406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf65a7a28a042aba970cd1f9d808a26, user_id=ad1299ef55564e9da5a3b0c1c4733028, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:21.901146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:21.914512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1247/2489] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:21 2022] PUT /identity/v3/projects/edf65a7a28a042aba970cd1f9d808a26/users/ad1299ef55564e9da5a3b0c1c4733028/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:21.924433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:21.924718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:21.924993 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:21.951457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] MFA Rules not processed for user `ad1299ef55564e9da5a3b0c1c4733028`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:21.952646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:22.020124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1243/2490] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:22.032843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.034519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:22.090521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6611c-b292-4066-aee0-0be6db3f17e1 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:22.094265 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:22.094850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.095155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.095455 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.105511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:22.107306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:22.120108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1248/2491] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:22.429292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.439185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cb5f2-aefd-42b4-8ad1-e25ef2527329 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:22.444046 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1299ef55564e9da5a3b0c1c4733028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf65a7a28a042aba970cd1f9d808a26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:22.444774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.445059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.445332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.446054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:22.446361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:22.447995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:22.462986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1244/2492] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:22.464022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.473180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b864dd-2ab5-48de-97c4-00a8e594b345 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:22.478816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1299ef55564e9da5a3b0c1c4733028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf65a7a28a042aba970cd1f9d808a26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:22.479890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.480173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.480459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.481167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:22.483050 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:22.513639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1249/2493] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:22 2022] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:22.514651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.525006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618a3c-8efc-4158-8daa-d54ca9a0e26d tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:22.591824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1299ef55564e9da5a3b0c1c4733028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf65a7a28a042aba970cd1f9d808a26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:22.591824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.591824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.592128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.592128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:22.592128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:22.592128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:22.599879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1245/2494] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:22.639888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.654474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05550-ed89-43fa-93bd-49240691697b tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:22.656856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1299ef55564e9da5a3b0c1c4733028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edf65a7a28a042aba970cd1f9d808a26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:22.657777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:22.658164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:22.658437 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] PATH_INFO: `/v3/projects/2bcad6f35dca4ab5a3edebd095f4f32a` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:22.659762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2bcad6f35dca4ab5a3edebd095f4f32a)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:22.661718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:22.709982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcad6f35dca4ab5a3edebd095f4f32a', 'request_id': 'req-5520b596-7320-48c6-9e9d-1519935a7987'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:22.715409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcad6f35dca4ab5a3edebd095f4f32a', 'request_id': 'req-5520b596-7320-48c6-9e9d-1519935a7987'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:22.721463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcad6f35dca4ab5a3edebd095f4f32a', 'request_id': 'req-5520b596-7320-48c6-9e9d-1519935a7987'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:22.733989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] The token cache is being invalidate because project 2bcad6f35dca4ab5a3edebd095f4f32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:22.734270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:22.734901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5520b596-7320-48c6-9e9d-1519935a7987 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:22.736461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1250/2495] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:22 2022] DELETE /identity/v3/projects/2bcad6f35dca4ab5a3edebd095f4f32a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:22.926887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:22.928729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:22.991594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3386ab-b0a2-4532-ba8c-4df0fed9ecd9 tempest-VolumeQuotaClassesTest-1720273808 tempest-VolumeQuotaClassesTest-1720273808-project-admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:23.045804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:23.046669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:23.046949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:23.047224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] PATH_INFO: `/v3/users/47e741bccb6a406388a830602e5f4815` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:23.048426 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e741bccb6a406388a830602e5f4815)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:23.050702 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:23.095517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e741bccb6a406388a830602e5f4815'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.096265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e741bccb6a406388a830602e5f4815'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.108213 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e741bccb6a406388a830602e5f4815'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.114749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e741bccb6a406388a830602e5f4815'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.115407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e741bccb6a406388a830602e5f4815'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.127966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1246/2496] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:22 2022] DELETE /identity/v3/users/47e741bccb6a406388a830602e5f4815 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:23.132535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:23.133026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:23.133135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:23.150580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:23.151802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:23.207933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1251/2497] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:23.217912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:23.219342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:23.276532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0cc4-86ed-4423-aceb-a010d7fe9dcd admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:23.280126 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:23.280760 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:23.281037 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:23.281304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:23.290804 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:23.292234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:23.301594 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1247/2498] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:23.569419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:23.571423 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:23.583401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0040d7-822a-4c28-9a1a-bf14031aac42 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:23.588822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:23.589673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:23.589947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:23.590215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] PATH_INFO: `/v3/projects/90a29284b5704576b29156dc5d712ce2` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:23.591404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a29284b5704576b29156dc5d712ce2)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:23.593303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:23.640881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a29284b5704576b29156dc5d712ce2', 'request_id': 'req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.646278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a29284b5704576b29156dc5d712ce2', 'request_id': 'req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.652264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a29284b5704576b29156dc5d712ce2', 'request_id': 'req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.664433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] The token cache is being invalidate because project 90a29284b5704576b29156dc5d712ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:23.665233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.665851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.667428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1252/2499] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:23 2022] DELETE /identity/v3/projects/90a29284b5704576b29156dc5d712ce2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:23.671402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:23.681282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d17d7-4e15-4542-9261-66f409b65638 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:23.740786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:23.741665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:23.741954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:23.742222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] PATH_INFO: `/v3/users/ad1299ef55564e9da5a3b0c1c4733028` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:23.744031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1299ef55564e9da5a3b0c1c4733028)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:23.745939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:23.800105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1299ef55564e9da5a3b0c1c4733028'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.800753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1299ef55564e9da5a3b0c1c4733028'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.813189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1299ef55564e9da5a3b0c1c4733028'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.823701 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1299ef55564e9da5a3b0c1c4733028'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.824418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-874b9633-3edc-4c5c-af8d-74f945f845d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1299ef55564e9da5a3b0c1c4733028'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:23.838965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1248/2500] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:23 2022] DELETE /identity/v3/users/ad1299ef55564e9da5a3b0c1c4733028 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:24.575198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:24.576855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:24.591541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869745-a0a3-4d86-8f78-18d4c9cbdab5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:24.658064 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:24.659196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:24.659637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:24.660009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] PATH_INFO: `/v3/projects/edf65a7a28a042aba970cd1f9d808a26` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:24.661415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf65a7a28a042aba970cd1f9d808a26)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:24.663465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:24.711433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf65a7a28a042aba970cd1f9d808a26', 'request_id': 'req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:24.718330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf65a7a28a042aba970cd1f9d808a26', 'request_id': 'req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:24.724975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf65a7a28a042aba970cd1f9d808a26', 'request_id': 'req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:24.738160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] The token cache is being invalidate because project edf65a7a28a042aba970cd1f9d808a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:24.738485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:24.739105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d67cd4c2-2c0c-4c74-a855-0e6d814f3932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:24.740726 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1253/2501] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:24 2022] DELETE /identity/v3/projects/edf65a7a28a042aba970cd1f9d808a26 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:24.745530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:24.746016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:24.746138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:24.763638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:24.765004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:24.832265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1249/2502] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:24.834590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:24.834590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:24.834851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:24.855345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:24.857134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:24.865402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1254/2503] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:24.870047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:24.880294 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c61b-0b93-4371-9382-aa714fd1ef85 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:24.885717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:24.886410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:24.886692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:24.886962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:24.887724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:24.888034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:24.889632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:24.905954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1250/2504] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:24.908479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:24.923555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ecec-e9fe-4e0c-af90-43a0e902fa67 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:24.928671 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:24.929360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:24.929638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:24.929907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:24.931131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:24.933249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:24.963651 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1255/2505] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:24 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:24.967848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:24.978486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5002-7188-40d6-bfd1-b10fba23e407 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.044518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.045284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.045561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.045830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.046525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.048548 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.072260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1251/2506] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:24 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:25.076621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.086872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef82a3-6f7d-4bb1-beb5-aa08d4d0be1f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.091652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.092298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.092574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.092844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.093558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.095166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.106433 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1256/2507] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:25.110522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.120922 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81cae3-151b-4e7c-8155-7e4f62e170c7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.125455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.126099 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.126375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.126680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.127459 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.129076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba88c-5622-469f-96d7-4d163f958584 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.139613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1252/2508] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:25.143576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.153251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a844-ec7b-42ae-98b4-a5e0ad46ae44 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.157793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.158656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.158931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.159200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] PATH_INFO: `/v3/projects/e9a260debf044705b2cd27ff7f7269db/users/7a6b9d3d418c4fdfb6eafe8f4b928bed/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.177904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a260debf044705b2cd27ff7f7269db, user_id=7a6b9d3d418c4fdfb6eafe8f4b928bed, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.181538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.196875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1257/2509] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:25 2022] PUT /identity/v3/projects/e9a260debf044705b2cd27ff7f7269db/users/7a6b9d3d418c4fdfb6eafe8f4b928bed/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:25.207668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.207957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.208232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.243433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] MFA Rules not processed for user `7a6b9d3d418c4fdfb6eafe8f4b928bed`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:25.243433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.335529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1253/2510] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:25.350584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.353326 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.434674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f4325-d577-47d1-ac8f-1b736072d2f0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.439000 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.439718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.440111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.440338 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.450564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.452082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.459183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.460786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.463774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1258/2511] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:25.484464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.526522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d44176-4ccd-4798-bc60-fffc235bff69 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.531104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.531999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.532288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.532552 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] PATH_INFO: `/v3/users/7ef55c51178f4f1380eab7a90f8bfb5d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.533756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef55c51178f4f1380eab7a90f8bfb5d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.535680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.544904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8a01f-25c3-404f-b870-4ea214746615 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.549471 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.550337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.550606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.550868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] PATH_INFO: `/v3/users/7a6b9d3d418c4fdfb6eafe8f4b928bed` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.552118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6b9d3d418c4fdfb6eafe8f4b928bed)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.554001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.580714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef55c51178f4f1380eab7a90f8bfb5d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.581414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef55c51178f4f1380eab7a90f8bfb5d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.593748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef55c51178f4f1380eab7a90f8bfb5d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.598390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6b9d3d418c4fdfb6eafe8f4b928bed'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.599038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6b9d3d418c4fdfb6eafe8f4b928bed'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.600320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef55c51178f4f1380eab7a90f8bfb5d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.600982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-05ea8336-9399-4c2f-aead-5543d5c7694a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef55c51178f4f1380eab7a90f8bfb5d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.611568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6b9d3d418c4fdfb6eafe8f4b928bed'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.613902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1254/2512] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:25 2022] DELETE /identity/v3/users/7ef55c51178f4f1380eab7a90f8bfb5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:25.618103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.618392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.618516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6b9d3d418c4fdfb6eafe8f4b928bed'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.618669 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.626467 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-41756f42-252c-49aa-848c-eb7d84334757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6b9d3d418c4fdfb6eafe8f4b928bed'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:25.633260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1259/2513] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:25 2022] DELETE /identity/v3/users/7a6b9d3d418c4fdfb6eafe8f4b928bed => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:25.636064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:25.637279 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.638123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.638448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.638797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.656853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:25.658052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.702759 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1255/2514] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:25.712114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.713543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.719746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1260/2515] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:25.729574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.730916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.784172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f8ad-557a-464f-8adb-7c787f813f14 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.788163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.788893 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.789178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.789505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.799751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.801147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedac56-f662-41d3-abc8-a8de1c705a1a service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.811595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1256/2516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:25.813249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff32382-1b37-4419-8297-1adb097aa0df None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:25.817286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:25.817935 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.818215 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.818487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.827008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:25.827470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:25.827818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:25.829908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:25.831400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:25.843091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1261/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:25.846441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:25.847675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:25.903427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1257/2518] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:47:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:25.954210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:25.956249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.032024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23fd9-84d7-46a4-a41a-2d1451d3ced2 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.038684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.040069 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.040743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.040743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.051731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.053342 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.063108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1262/2519] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:47:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:47:26.178752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.181063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.199150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d250a-c5fe-41b4-84ba-e8263622b0ae None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.204417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.205176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.205454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.205756 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] PATH_INFO: `/v3/projects/4bb1ecb3873e4fa895db4c27e4f658aa` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.207166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb1ecb3873e4fa895db4c27e4f658aa)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.209251 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.244423 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.246391 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.267148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d229-b128-4895-bddf-57c1ad5199ab service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.270779 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb1ecb3873e4fa895db4c27e4f658aa', 'request_id': 'req-7a116d14-ae6f-4ef7-b848-8b20e013cac6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.281291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb1ecb3873e4fa895db4c27e4f658aa', 'request_id': 'req-7a116d14-ae6f-4ef7-b848-8b20e013cac6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.288082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb1ecb3873e4fa895db4c27e4f658aa', 'request_id': 'req-7a116d14-ae6f-4ef7-b848-8b20e013cac6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.301722 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] The token cache is being invalidate because project 4bb1ecb3873e4fa895db4c27e4f658aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:26.302246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.302984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.305053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1258/2520] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:26 2022] DELETE /identity/v3/projects/4bb1ecb3873e4fa895db4c27e4f658aa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:26.310050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.311510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.337491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.338408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.338681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.338943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] PATH_INFO: `/v3/projects/e9a260debf044705b2cd27ff7f7269db` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.340428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a260debf044705b2cd27ff7f7269db)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.342565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.382717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116d14-ae6f-4ef7-b848-8b20e013cac6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.390434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a260debf044705b2cd27ff7f7269db', 'request_id': 'req-2848d149-572d-4375-a405-80a154168f5e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.396351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a260debf044705b2cd27ff7f7269db', 'request_id': 'req-2848d149-572d-4375-a405-80a154168f5e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.403227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a260debf044705b2cd27ff7f7269db', 'request_id': 'req-2848d149-572d-4375-a405-80a154168f5e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.417727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] The token cache is being invalidate because project e9a260debf044705b2cd27ff7f7269db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:26.418156 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.418908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2848d149-572d-4375-a405-80a154168f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.420831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1263/2521] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:26 2022] DELETE /identity/v3/projects/e9a260debf044705b2cd27ff7f7269db => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:26.425406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489927b3-ce29-4072-9bd8-929dfec69c0e None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.430500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489927b3-ce29-4072-9bd8-929dfec69c0e None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.430776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489927b3-ce29-4072-9bd8-929dfec69c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.450400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-489927b3-ce29-4072-9bd8-929dfec69c0e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:26.452950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-489927b3-ce29-4072-9bd8-929dfec69c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.464022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.464905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.465185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.465454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] PATH_INFO: `/v3/users/623722ba42bb4b428b859027d1c61913` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.466703 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623722ba42bb4b428b859027d1c61913)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.468646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.512232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1264/2522] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:26.519093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623722ba42bb4b428b859027d1c61913'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.519873 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623722ba42bb4b428b859027d1c61913'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.520952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.521238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.521515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.532711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623722ba42bb4b428b859027d1c61913'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.540318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623722ba42bb4b428b859027d1c61913'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.540891 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:26.541014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623722ba42bb4b428b859027d1c61913'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.542085 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.550849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1265/2523] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:26.554730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.555246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1259/2524] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:26 2022] DELETE /identity/v3/users/623722ba42bb4b428b859027d1c61913 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:26.564321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff407ea-2a1b-4ad0-924f-8334b32a0307 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.635256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.636721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.636908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.637209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.638014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:26.638743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.640549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.655588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1266/2525] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:26.660104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.670473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb78df-9c84-49e4-8368-95e76fe63a68 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.675649 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.676310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.676596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.676868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.677577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.679492 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.711187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1260/2526] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:26.724868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.739143 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d18177-68e8-4521-a3bb-eb991937caab admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.811353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.812419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.812696 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.812967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.813652 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.815822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.839217 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1267/2527] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:26.845652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.852248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.856230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:26.856393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854b849-8916-4bce-97b8-8710f1acc5b9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.861226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.861907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.862404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.862849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.863771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.865533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.874160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d77d-a15a-40e0-b66b-b92b2a455c1e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.878069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1261/2528] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:26.879315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.880546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.881003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.881621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] PATH_INFO: `/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.882830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dd7b5c4a1e4fdc864f0b0989fc541e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.882962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.885416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.893566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c5f95-9cc9-4ad6-8da4-03c6df2b98af admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.900465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:26.901359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.901802 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.902248 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.903183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:26.904967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:26.916048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1262/2529] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:26.920327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:26.930419 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c85fb9-a8b4-45d2-9016-8c28e2bcc336 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:26.938171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dd7b5c4a1e4fdc864f0b0989fc541e', 'request_id': 'req-b5607a1e-ed49-4520-9371-4db309e7e68a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.944646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dd7b5c4a1e4fdc864f0b0989fc541e', 'request_id': 'req-b5607a1e-ed49-4520-9371-4db309e7e68a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.952965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dd7b5c4a1e4fdc864f0b0989fc541e', 'request_id': 'req-b5607a1e-ed49-4520-9371-4db309e7e68a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.967926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] The token cache is being invalidate because project 49dd7b5c4a1e4fdc864f0b0989fc541e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:26.968123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.968741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b5607a1e-ed49-4520-9371-4db309e7e68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:26.973982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1268/2530] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:26 2022] DELETE /identity/v3/projects/49dd7b5c4a1e4fdc864f0b0989fc541e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:26.975372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764976d-3f25-445c-87e7-fe5d356afd7c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:26.975659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764976d-3f25-445c-87e7-fe5d356afd7c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:26.975921 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764976d-3f25-445c-87e7-fe5d356afd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:26.995104 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-7764976d-3f25-445c-87e7-fe5d356afd7c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:26.996365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7764976d-3f25-445c-87e7-fe5d356afd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.004161 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.005080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.005371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.005635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] PATH_INFO: `/v3/projects/2c361cdb8bd54b2fb6e07a4c5f0f2faf/users/67a3ce79c1084843b6a69f6b8d72d7cb/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.021133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c361cdb8bd54b2fb6e07a4c5f0f2faf, user_id=67a3ce79c1084843b6a69f6b8d72d7cb, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.023907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6159-4d96-476c-9bf3-089dccbc0d3d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.038648 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1263/2531] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:26 2022] PUT /identity/v3/projects/2c361cdb8bd54b2fb6e07a4c5f0f2faf/users/67a3ce79c1084843b6a69f6b8d72d7cb/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:27.048532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.048879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.049221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.064540 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1269/2532] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:27.074284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.074650 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.074999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.077767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] MFA Rules not processed for user `67a3ce79c1084843b6a69f6b8d72d7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:27.079138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.094146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:27.095535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.151403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1264/2533] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:27.155495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.156832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.162751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1270/2534] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:27.164290 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.173894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8202fb4-9d3b-42c7-8ad6-a65c218a8283 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.175619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e631-1bff-4302-bdc8-1a536849ee8d None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.179106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.179945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.180847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.181314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.181817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.182543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.183057 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.183920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.184196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.185588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:27.185894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.186004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.187723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.205067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1271/2535] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:27.208532 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.215984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1265/2536] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:27.219457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.223608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f47d8d-b722-402e-9cc4-8c7057b56c14 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.284056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.284322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2caf1-94f8-4f33-9a73-0a8e15045128 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.284970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.285486 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.285889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.286682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.288720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.289080 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.290302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.290688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.290906 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.291632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.294395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.317277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1272/2537] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:27.317528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1266/2538] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:27.322043 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.323925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.332631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e533-3512-4bf8-a210-fe45fae68307 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.388824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2cd43-9880-477c-923e-e2934370b48a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.394079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.394762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.395046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.395344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.395880 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.396071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.396793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.396793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.397103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.397676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.397788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.400083 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.409309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1273/2539] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:27.413851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.428850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932d82a-567e-4f28-9704-11fdab5c8fa5 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.431898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1267/2540] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:27.434660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.435435 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.435716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.435997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.436139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.436886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.438697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.452079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1274/2541] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:27.455253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524d7d2-fffd-4979-8344-6e90a6e5fbb9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.457171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.459753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.460499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.460847 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.461184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.462133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.465158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.468331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001611d1-de08-483a-9031-3d1fe00b00ba admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.473950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.474920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.475211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.475679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] PATH_INFO: `/v3/projects/afa667f7b1e44e1fac684bf524e23833/users/448f5edc3e7245009889cf007ca52db6/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.479087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1268/2542] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:27.482746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.492108 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa667f7b1e44e1fac684bf524e23833, user_id=448f5edc3e7245009889cf007ca52db6, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.495844 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b5a29-9a64-4e95-9d29-c934159a9bd7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.496643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf351e28-846a-4166-9bda-d9241012d356 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.503732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.505019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.505683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.506234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.507149 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.510425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.515197 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1275/2543] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:27 2022] PUT /identity/v3/projects/afa667f7b1e44e1fac684bf524e23833/users/448f5edc3e7245009889cf007ca52db6/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:27.526169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.527924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1269/2544] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:27.531137 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.532100 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.532554 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.543654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab37d2-f048-4716-86e1-f87f3e046b37 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.570574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] MFA Rules not processed for user `448f5edc3e7245009889cf007ca52db6`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:27.572849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.620895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.621811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.622101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.623204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] PATH_INFO: `/v3/projects/8461fc725e6346b5ad970d651c8185bd/users/ea4646d02e2e489ca5a9fb4fa2abd031/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.644461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8461fc725e6346b5ad970d651c8185bd, user_id=ea4646d02e2e489ca5a9fb4fa2abd031, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.648477 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf696bcd-8e40-4281-81a9-47287b017466 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.652678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1276/2545] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:27.657419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.668979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2e9a9-5e44-4919-9c11-cacb6f0754d9 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.679439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1270/2546] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:27 2022] PUT /identity/v3/projects/8461fc725e6346b5ad970d651c8185bd/users/ea4646d02e2e489ca5a9fb4fa2abd031/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:27.685546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.685829 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.686108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.723033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] MFA Rules not processed for user `ea4646d02e2e489ca5a9fb4fa2abd031`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:27.724534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:27.750071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.750832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.751847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.752238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.753456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.755911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.794892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1277/2547] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:27.798582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.805693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1271/2548] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:27.807247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.817609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc695d6-a1e2-477f-a057-f34f01addb28 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.866623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e259-bf5b-42b3-92cf-85bd3749b1eb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.872210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.872688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.872970 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.873243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.873928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.875980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.878581 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.879358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.879713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.880060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.880816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.882788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.898129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1278/2549] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:27.902638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.912903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248375b-15e8-4ff1-b6ec-e3801b1103b0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.915789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1272/2550] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:27.919603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.973702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.974373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.974711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.974931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.975689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:27.978577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:27.991735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1279/2551] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:27.991963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499a656-c9c1-4e02-a9f3-b63c84e9ccb4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:27.993393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:27.996556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:27.997228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:27.997510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:27.997787 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:27.998483 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.000706 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.003768 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59da14-7373-4065-9fdc-0c07a866662f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.008745 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.009620 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.009902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.010183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] PATH_INFO: `/v3/projects/bb1a00492cf14f258f0ede57eae9d861/users/0cbbda65817349a0ab96b134cab6e779/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.021705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1273/2552] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:27 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:28.026376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1a00492cf14f258f0ede57eae9d861, user_id=0cbbda65817349a0ab96b134cab6e779, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.026541 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.029333 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.041647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372336-06ad-4098-9b88-e552815057ec admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.043838 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1280/2553] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:27 2022] PUT /identity/v3/projects/bb1a00492cf14f258f0ede57eae9d861/users/0cbbda65817349a0ab96b134cab6e779/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:28.047731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.099033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.099748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.100034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.100313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.101039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.103187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.109122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e527d6-90a4-4810-9bdb-8edcccafafdc admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.113677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.114438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1274/2554] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:28.114559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.114643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.114916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.115599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.117485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.118833 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.128862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1281/2555] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:28.129092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a966f-82d1-4121-b7d7-82848aa1f850 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.134347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.134759 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.135238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.135553 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.135830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] PATH_INFO: `/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd/users/b85e654442ca4104a97996251762fef6/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.145071 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd193bf6-8be4-4e91-a2a8-70338b5b7324 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.150684 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.151724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.151853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d49b3d1adc94c6784517618c0ed1fdd, user_id=b85e654442ca4104a97996251762fef6, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.152254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.152562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] PATH_INFO: `/v3/projects/bb1a00492cf14f258f0ede57eae9d861/users/0cbbda65817349a0ab96b134cab6e779/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.154734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.155343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1a00492cf14f258f0ede57eae9d861, user_id=0cbbda65817349a0ab96b134cab6e779, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.158036 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8a4e-c874-46ae-8fc9-2ac9938e59db admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.172682 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1275/2556] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:28 2022] PUT /identity/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd/users/b85e654442ca4104a97996251762fef6/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:28.173673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1282/2557] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:28 2022] PUT /identity/v3/projects/bb1a00492cf14f258f0ede57eae9d861/users/0cbbda65817349a0ab96b134cab6e779/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:28.175823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.189812 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.190100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.190370 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.225639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] MFA Rules not processed for user `0cbbda65817349a0ab96b134cab6e779`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:28.226887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:28.275981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210258-80cc-43ac-be87-0deca82f965c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.319562 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1283/2558] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:28.327136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.331779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:28.340038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.341466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.341852 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.342720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.343596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.345904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.359980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1276/2559] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:28.363947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.376266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109e8f-9984-4e07-8796-b788eed2e849 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.383911 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.384809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.386752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.387035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] PATH_INFO: `/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd/users/b85e654442ca4104a97996251762fef6/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.389082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d49b3d1adc94c6784517618c0ed1fdd, user_id=b85e654442ca4104a97996251762fef6, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.391773 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288af06-ff61-46f5-baec-36f00701f393 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.405408 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d79a0-fff1-478c-8def-ea5245552427 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.406201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1277/2560] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:28 2022] PUT /identity/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd/users/b85e654442ca4104a97996251762fef6/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:28.417608 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.418103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.418663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.454763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] MFA Rules not processed for user `b85e654442ca4104a97996251762fef6`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:28.456069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:28.472445 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.473093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.473366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.473630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.540809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1278/2561] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:28.549803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.551785 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.554625 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.556180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:28.571077 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1284/2562] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:28.571853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92624-28f1-4ba1-ac04-7e70a93d4eb4 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.577883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.579167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.579582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.579930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.596486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.598013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6eba5-a8bc-4146-a011-e7a67bc704f0 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.623903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1279/2563] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:28.653637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:28.763390 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2a87-0c76-4a20-9364-9e99ddc731e8 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:28.782228 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:28.784319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.785041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.785759 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] PATH_INFO: `/v3/users/ea4646d02e2e489ca5a9fb4fa2abd031` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.788626 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4646d02e2e489ca5a9fb4fa2abd031)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:28.791793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:28.856498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4646d02e2e489ca5a9fb4fa2abd031'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:28.857327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4646d02e2e489ca5a9fb4fa2abd031'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:28.895835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4646d02e2e489ca5a9fb4fa2abd031'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:28.919797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4646d02e2e489ca5a9fb4fa2abd031'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:28.931321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4646d02e2e489ca5a9fb4fa2abd031'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:28.940485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1285/2564] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:28 2022] DELETE /identity/v3/users/ea4646d02e2e489ca5a9fb4fa2abd031 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:28.946842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:28.947776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:28.948549 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:28.970494 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:28.972064 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:29.040543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1280/2565] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:29.049494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:29.050987 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:29.111121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf400892-6118-4d44-850f-80b50eb04046 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:29.114770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:29.115453 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.115736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.116010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.125732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:29.127179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:29.137877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1286/2566] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:29.471781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:29.473810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:29.491943 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e8ff7-aa69-496b-bef0-12ea71a81369 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:29.497502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:29.498427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.498709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.499014 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] PATH_INFO: `/v3/projects/8461fc725e6346b5ad970d651c8185bd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.504078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8461fc725e6346b5ad970d651c8185bd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:29.506192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:29.567992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8461fc725e6346b5ad970d651c8185bd', 'request_id': 'req-12710082-efd6-4ebe-8ace-742400581f65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.584901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8461fc725e6346b5ad970d651c8185bd', 'request_id': 'req-12710082-efd6-4ebe-8ace-742400581f65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.593555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8461fc725e6346b5ad970d651c8185bd', 'request_id': 'req-12710082-efd6-4ebe-8ace-742400581f65'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.606539 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] The token cache is being invalidate because project 8461fc725e6346b5ad970d651c8185bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:29.606871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.607958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.609490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1281/2567] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:29 2022] DELETE /identity/v3/projects/8461fc725e6346b5ad970d651c8185bd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:29.613353 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:29.639551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b622d-08a1-48d1-8752-610ca8c49326 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:29.723325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:29.724443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:29.724788 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:29.725126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] PATH_INFO: `/v3/users/b85e654442ca4104a97996251762fef6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:29.726463 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85e654442ca4104a97996251762fef6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:29.729045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:29.783772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85e654442ca4104a97996251762fef6'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.784436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85e654442ca4104a97996251762fef6'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.796978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85e654442ca4104a97996251762fef6'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.804558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85e654442ca4104a97996251762fef6'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.814813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85e654442ca4104a97996251762fef6'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:29.821960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1287/2568] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:29 2022] DELETE /identity/v3/users/b85e654442ca4104a97996251762fef6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:30.234389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.235224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:30.306357 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710082-efd6-4ebe-8ace-742400581f65 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.355633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.357164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:30.362567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.363227 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.363535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.363809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.365593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:30.435167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e563f79-0aee-4078-adbe-ae98fba310a3 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.440811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.441884 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.442313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.442695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] PATH_INFO: `/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.444366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d49b3d1adc94c6784517618c0ed1fdd)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.446961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.447560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.449351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20d452-0044-4c39-929b-cb93c7f3e263 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.460059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1282/2569] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:30.498039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d49b3d1adc94c6784517618c0ed1fdd', 'request_id': 'req-ff139f22-792a-4025-811b-cb6e1f574e7d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:30.505820 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d49b3d1adc94c6784517618c0ed1fdd', 'request_id': 'req-ff139f22-792a-4025-811b-cb6e1f574e7d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:30.513985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d49b3d1adc94c6784517618c0ed1fdd', 'request_id': 'req-ff139f22-792a-4025-811b-cb6e1f574e7d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:30.531082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] The token cache is being invalidate because project 2d49b3d1adc94c6784517618c0ed1fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:30.531800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:30.532539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ff139f22-792a-4025-811b-cb6e1f574e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:30.534478 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1288/2570] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:30 2022] DELETE /identity/v3/projects/2d49b3d1adc94c6784517618c0ed1fdd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:30.539351 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.539659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.539928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.557705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:30.558929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:30.624522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1283/2571] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:30.632939 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.633865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.634233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.654698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:30.656681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:30.666130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1289/2572] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:30.670495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.682280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208690df-9811-4eb1-8a08-251df1fb010e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.687410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.688184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.688543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.688887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.689685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:30.690060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.691754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.705503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1284/2573] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:30.709843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.720171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a6ff-b376-47a1-b452-8cc102432585 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.726655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.727366 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.727802 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.728090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.728943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.731157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.761132 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1290/2574] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:30 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:30.764970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.777033 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de008-95f2-44ee-adff-1586428bb47c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.835627 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.836388 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.836785 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.837150 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.837958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.840022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.860490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1285/2575] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:30 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:30.864931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.881487 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6e09-3607-4fa4-99cb-30b87bb79b69 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.888955 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.889960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.890318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.890743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.891841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.893787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.907597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1291/2576] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:30.911739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.922028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4197f3-53f0-4f96-a1e8-167ddd745a76 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.927256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.928324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.928529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.928810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:30.929654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:30.931834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f386b8-ccfe-40c2-b389-a40d2cccdca7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:30.950841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1286/2577] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:30.955251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:30.970200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc14f-fd67-4a0d-b4fb-cafb9073a391 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:30.977738 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:30.979538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:30.979819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:30.981133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] PATH_INFO: `/v3/projects/6ab5b812d7104622a60ad96c75b0ee20/users/ef15914aad254c398e09cc1ed8cc4857/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.006775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab5b812d7104622a60ad96c75b0ee20, user_id=ef15914aad254c398e09cc1ed8cc4857, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.006775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.027030 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1292/2578] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:30 2022] PUT /identity/v3/projects/6ab5b812d7104622a60ad96c75b0ee20/users/ef15914aad254c398e09cc1ed8cc4857/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:31.038296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.038592 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.038868 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.041107 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.042978 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.068869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] MFA Rules not processed for user `ef15914aad254c398e09cc1ed8cc4857`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:31.070187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.109164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad287857-8e82-4c25-9a06-ef03013d68b8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.113199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.113845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.114465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.114465 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.116226 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.147310 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1287/2579] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:31.149418 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.192933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.194373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.212710 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1293/2580] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:31.222561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c08035-5af1-4c20-900e-b9de712757eb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.229566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.230368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.230652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.230931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.231688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.234204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.265295 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1288/2581] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:31.269429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.286176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8abfd7-a9c6-4283-9c4a-10c6227cffc8 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.368249 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.368843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.369148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.369426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.370171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.372141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.397053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1294/2582] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:31.401002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.411337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c7830-db01-4171-a1b0-e9697b0a5fbc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.416002 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.416661 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.416940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.417287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.418004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.419671 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.430936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1289/2583] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:31.435100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.445376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c4ba-0d84-4b00-89b3-ab7b2b6daee2 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.451103 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.452040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.452321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.452596 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] PATH_INFO: `/v3/projects/58fdd7bb995b42249b791befee8d1a45/users/6c9491addfc3407a8cf24e6f6cd7c0ff/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.469273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fdd7bb995b42249b791befee8d1a45, user_id=6c9491addfc3407a8cf24e6f6cd7c0ff, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.472282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.488345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1295/2584] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:31 2022] PUT /identity/v3/projects/58fdd7bb995b42249b791befee8d1a45/users/6c9491addfc3407a8cf24e6f6cd7c0ff/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:31.493139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.503449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d94e7-954e-440a-a251-ddb88bb93cfc admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.566514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.567197 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.567512 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.567793 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.568518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.570116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4b9b-33ce-44a6-8d51-51ac373036b4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.584771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1290/2585] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:31.586002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.598018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b702-7eb7-4746-bab5-108c48b9c7fa admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.603438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.604376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.604655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.604931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] PATH_INFO: `/v3/projects/58fdd7bb995b42249b791befee8d1a45/users/6c9491addfc3407a8cf24e6f6cd7c0ff/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.606983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fdd7bb995b42249b791befee8d1a45, user_id=6c9491addfc3407a8cf24e6f6cd7c0ff, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.609733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.620786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1296/2586] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:31 2022] PUT /identity/v3/projects/58fdd7bb995b42249b791befee8d1a45/users/6c9491addfc3407a8cf24e6f6cd7c0ff/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:31.632463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.632811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.633131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.661135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] MFA Rules not processed for user `6c9491addfc3407a8cf24e6f6cd7c0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:31.662361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:31.730930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1291/2587] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:31.742102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.795712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab942f-b90c-47ff-a481-f76441381202 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.799434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.800072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.800352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.800625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.809595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.811022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990d55-b16e-480a-a815-f41d8e5ad969 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:31.820348 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1297/2588] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:31.885910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:31.946622 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e8d7-bbf0-43c1-b345-a98a743427c0 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:31.951652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:31.952527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:31.952809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:31.953085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] PATH_INFO: `/v3/users/ef15914aad254c398e09cc1ed8cc4857` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:31.954290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef15914aad254c398e09cc1ed8cc4857)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:31.956231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:32.006859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef15914aad254c398e09cc1ed8cc4857'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.007590 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef15914aad254c398e09cc1ed8cc4857'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.020602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef15914aad254c398e09cc1ed8cc4857'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.028188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef15914aad254c398e09cc1ed8cc4857'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.028920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef15914aad254c398e09cc1ed8cc4857'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.044030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1292/2589] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:31 2022] DELETE /identity/v3/users/ef15914aad254c398e09cc1ed8cc4857 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:32.048814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:32.049105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:32.049396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:32.069743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:32.071656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:32.135551 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1298/2590] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:32.146409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:32.148320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:32.216018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8aa0b-12e7-421b-84f6-ccb0600aec03 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:32.221190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:32.221774 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:32.222063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:32.222335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:32.233609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:32.235159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:32.246981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1293/2591] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:32.723384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:32.726427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:32.757890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118fa8-33ce-4ea1-801d-fba3ec87cb52 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:32.767194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:32.768242 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:32.768523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:32.768795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] PATH_INFO: `/v3/projects/6ab5b812d7104622a60ad96c75b0ee20` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:32.770066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab5b812d7104622a60ad96c75b0ee20)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:32.772856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:32.828382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab5b812d7104622a60ad96c75b0ee20', 'request_id': 'req-43780d85-5428-4504-b10e-fac9faa85b10'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.834053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab5b812d7104622a60ad96c75b0ee20', 'request_id': 'req-43780d85-5428-4504-b10e-fac9faa85b10'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.840855 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab5b812d7104622a60ad96c75b0ee20', 'request_id': 'req-43780d85-5428-4504-b10e-fac9faa85b10'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.853412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] The token cache is being invalidate because project 6ab5b812d7104622a60ad96c75b0ee20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:32.853781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.854462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.856264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1299/2592] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:32 2022] DELETE /identity/v3/projects/6ab5b812d7104622a60ad96c75b0ee20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:32.860096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:32.869988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98aab7-7015-45c9-8e20-ef0b30ae21c0 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:32.927806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:32.929236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:32.929520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:32.929794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] PATH_INFO: `/v3/users/6c9491addfc3407a8cf24e6f6cd7c0ff` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:32.931060 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9491addfc3407a8cf24e6f6cd7c0ff)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:32.933111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:32.982125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9491addfc3407a8cf24e6f6cd7c0ff'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.982698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9491addfc3407a8cf24e6f6cd7c0ff'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:32.994267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9491addfc3407a8cf24e6f6cd7c0ff'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.000903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9491addfc3407a8cf24e6f6cd7c0ff'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.001571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-9e0f144a-c6ec-4f23-acfb-937f2556fc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9491addfc3407a8cf24e6f6cd7c0ff'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.014555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1294/2593] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:32 2022] DELETE /identity/v3/users/6c9491addfc3407a8cf24e6f6cd7c0ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:33.491379 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:33.493004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:33.515973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43780d85-5428-4504-b10e-fac9faa85b10 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:33.595616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:33.596497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:33.596774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:33.597039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] PATH_INFO: `/v3/projects/58fdd7bb995b42249b791befee8d1a45` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:33.598234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fdd7bb995b42249b791befee8d1a45)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:33.600202 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:33.655902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fdd7bb995b42249b791befee8d1a45', 'request_id': 'req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.663053 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fdd7bb995b42249b791befee8d1a45', 'request_id': 'req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.670010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fdd7bb995b42249b791befee8d1a45', 'request_id': 'req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.692944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] The token cache is being invalidate because project 58fdd7bb995b42249b791befee8d1a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:33.693590 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.694644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-d1c918d8-d1ad-4d7d-83d0-dc197c94bbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:33.701834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1300/2594] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:33 2022] DELETE /identity/v3/projects/58fdd7bb995b42249b791befee8d1a45 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:33.703874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:33.704503 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:33.704984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:33.723454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:33.724684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:33.792733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1295/2595] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:33.800959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:33.801431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:33.801544 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:33.830749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:33.832447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:33.842208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1301/2596] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:33.847173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:33.858411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79aab3-3899-4545-967f-78d2c778c0ed None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:33.864359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:33.865658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:33.866098 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:33.866526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:33.867464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:33.867950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:33.869711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:33.884168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1296/2597] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:33.889494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:33.912314 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f4f1-089e-412f-bf21-65599d2c43f8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:33.920969 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:33.922260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:33.922546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:33.922997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:33.923747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:33.926223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:33.985281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1302/2598] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:33 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:33.986323 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:33.997753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b11c-92c4-41e5-b96a-5fb2f7d96e01 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.049383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.052502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.078194 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.079011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.079233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.079736 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.080589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.082495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.113589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1297/2599] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:33 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:34.114684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.129193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49782a-641b-4dd2-9974-2779bcb047ae admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.133848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2e2a-5d43-4327-80d5-f667d44b9042 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.136824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.137497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.137816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.138021 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.138730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.140051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.140500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.141201 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.141576 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.141953 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] PATH_INFO: `/v3/users/bd7b114dcefa4088851a61b3c7283b21` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.143331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7b114dcefa4088851a61b3c7283b21)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.145444 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.155086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1298/2600] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:34.156881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.169054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f352011-614b-4010-8c02-c45112840769 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.175045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.176141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.176575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.176884 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.177849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.181545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.201988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1299/2601] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:34.206766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.212870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7b114dcefa4088851a61b3c7283b21'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.213670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7b114dcefa4088851a61b3c7283b21'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.219930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897be6-080b-451d-9837-400a01f16c58 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.225586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.226650 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.227711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.228146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] PATH_INFO: `/v3/projects/b38748e0fcfb4574b6b860aac33eaec7/users/7f1a8486356248d4b537f7d8de3854c9/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.233411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7b114dcefa4088851a61b3c7283b21'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.244307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7b114dcefa4088851a61b3c7283b21'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.252677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38748e0fcfb4574b6b860aac33eaec7, user_id=7f1a8486356248d4b537f7d8de3854c9, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.255469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43a92f-53fc-4535-8150-ff4dfaa611cc admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.255678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7b114dcefa4088851a61b3c7283b21'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.277798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1300/2602] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:34 2022] PUT /identity/v3/projects/b38748e0fcfb4574b6b860aac33eaec7/users/7f1a8486356248d4b537f7d8de3854c9/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:34.278090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1303/2603] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:34 2022] DELETE /identity/v3/users/bd7b114dcefa4088851a61b3c7283b21 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:34.279867 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.280157 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.280610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.316145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] MFA Rules not processed for user `7f1a8486356248d4b537f7d8de3854c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:34.319979 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.389377 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1301/2604] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:34.394129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.395716 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.459120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.460663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.468264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2a79d-291c-45c2-8683-8266e8e922fb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.475207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.476113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.476381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.476747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.477555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.478810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb703be-fd01-43ee-af8a-d67623be25b1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.479558 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.484365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.485361 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.485715 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.486058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] PATH_INFO: `/v3/projects/ee00a37abf8a49eba7d06738e181eb4b` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.487338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee00a37abf8a49eba7d06738e181eb4b)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.489605 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.506878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1304/2605] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:34.511706 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.542866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee00a37abf8a49eba7d06738e181eb4b', 'request_id': 'req-be18685f-1caa-4a8a-852d-86b55f91c8e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.550363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee00a37abf8a49eba7d06738e181eb4b', 'request_id': 'req-be18685f-1caa-4a8a-852d-86b55f91c8e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.556561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee00a37abf8a49eba7d06738e181eb4b', 'request_id': 'req-be18685f-1caa-4a8a-852d-86b55f91c8e9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.567856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] The token cache is being invalidate because project ee00a37abf8a49eba7d06738e181eb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:34.568145 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.568795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.570643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1302/2606] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:34 2022] DELETE /identity/v3/projects/ee00a37abf8a49eba7d06738e181eb4b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:34.574865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6add0d-b480-4d86-a8f3-1eea97337589 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.575112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.576484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.629474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.630260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.630537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.630813 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.631521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.633508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.637621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18685f-1caa-4a8a-852d-86b55f91c8e9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.642219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.643224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.643529 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.643798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] PATH_INFO: `/v3/users/6014c95eee3841c8b5169246555009b9` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.645075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6014c95eee3841c8b5169246555009b9)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.647008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.652898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1305/2607] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:34.656836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.658387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.670477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b8b88-52da-494b-a09e-c5f225d64705 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.675577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.676219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.676528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.676926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.677613 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.679283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.689908 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1306/2608] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:34.691946 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6014c95eee3841c8b5169246555009b9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.692612 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6014c95eee3841c8b5169246555009b9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.693845 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.705052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cddd2-13ac-440f-ba2d-86de200be166 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.706019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6014c95eee3841c8b5169246555009b9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.709648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.710506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.710786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.711065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] PATH_INFO: `/v3/projects/7022c9368cee407498f0840b8b4eca4c/users/c338b7d643fa483fb5fbf8afd0132e9e/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.712646 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6014c95eee3841c8b5169246555009b9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.713324 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6014c95eee3841c8b5169246555009b9'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:34.725402 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7022c9368cee407498f0840b8b4eca4c, user_id=c338b7d643fa483fb5fbf8afd0132e9e, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.726086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1303/2609] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:34 2022] DELETE /identity/v3/users/6014c95eee3841c8b5169246555009b9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:34.728699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.741526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1307/2610] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:34 2022] PUT /identity/v3/projects/7022c9368cee407498f0840b8b4eca4c/users/c338b7d643fa483fb5fbf8afd0132e9e/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:34.745947 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.747547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.811159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5d452-e627-45e1-85a6-bddea414382b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.865369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.866167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.866453 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.866725 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.867508 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.869118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.878777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1304/2611] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:34.882821 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.893724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d586d-8668-48ea-83d5-16eb26b72726 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.899657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.900591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.900869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.901469 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] PATH_INFO: `/v3/projects/7022c9368cee407498f0840b8b4eca4c/users/c338b7d643fa483fb5fbf8afd0132e9e/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.902062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:34.903177 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7022c9368cee407498f0840b8b4eca4c, user_id=c338b7d643fa483fb5fbf8afd0132e9e, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.904226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.906039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356895f5-b7d0-4d8f-abc1-853c56c54cde admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:34.917789 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef21ae-63c5-46a4-b20b-8ea761b22ca3 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:34.919975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1308/2612] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:34 2022] PUT /identity/v3/projects/7022c9368cee407498f0840b8b4eca4c/users/c338b7d643fa483fb5fbf8afd0132e9e/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:34.929770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.936166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.936458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.964985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] MFA Rules not processed for user `c338b7d643fa483fb5fbf8afd0132e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:34.966275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:34.975623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:34.976484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:34.977303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:34.977576 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] PATH_INFO: `/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:34.978745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d1f49a17b6456ebc79bcd41fd27172)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:34.980663 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.025781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d1f49a17b6456ebc79bcd41fd27172', 'request_id': 'req-f2457ab5-f9eb-46db-8bee-a00b8298c7db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.034413 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d1f49a17b6456ebc79bcd41fd27172', 'request_id': 'req-f2457ab5-f9eb-46db-8bee-a00b8298c7db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.037196 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1309/2613] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:35.044473 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d1f49a17b6456ebc79bcd41fd27172', 'request_id': 'req-f2457ab5-f9eb-46db-8bee-a00b8298c7db'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.049505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.050917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.056526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] The token cache is being invalidate because project e0d1f49a17b6456ebc79bcd41fd27172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:35.056814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.057474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f2457ab5-f9eb-46db-8bee-a00b8298c7db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.059030 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1305/2614] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:34 2022] DELETE /identity/v3/projects/e0d1f49a17b6456ebc79bcd41fd27172 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:35.064053 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97964-996f-4f88-911d-60c378dcee93 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.064341 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97964-996f-4f88-911d-60c378dcee93 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.064628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97964-996f-4f88-911d-60c378dcee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.082474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cba97964-996f-4f88-911d-60c378dcee93 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:35.083835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cba97964-996f-4f88-911d-60c378dcee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.107378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c70cb-6ceb-4fa1-b00a-060a045ee476 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.142448 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1306/2615] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:35.150464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.150751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.151023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.154474 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.155115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.155425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.155700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.157479 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.169078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:35.170228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.181055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1307/2616] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:35.182393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.191201 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc9378-15d0-444e-a137-5b67dbbad885 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.195795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.196438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.196720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.196994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.197709 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:35.198012 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.199898 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.210960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1308/2617] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:47:35.215577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.219772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.221236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.224757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d6eb6-2c30-4d33-99ee-598422317579 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.229895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.230515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.230795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.231071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.231171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1310/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:35.231781 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.233659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.258461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1309/2619] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:35.262686 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.279824 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fabd0-3a50-467b-937a-64bc8eb74ce6 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.331693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.333439 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.345297 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.346188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.346711 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.346927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.347661 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.349564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.371655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1311/2620] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:35.371655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.371655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.383155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49280e-5d8e-46fc-94b5-19ccb4ed5029 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.388139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.388996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.389273 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.389547 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] PATH_INFO: `/v3/users/67a3ce79c1084843b6a69f6b8d72d7cb` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.390731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a3ce79c1084843b6a69f6b8d72d7cb)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.392654 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.397721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dbbe3-9301-4331-bed3-0d1145bc1815 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.401939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.402582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.402861 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.403133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.405490 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.438400 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a3ce79c1084843b6a69f6b8d72d7cb'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.439135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a3ce79c1084843b6a69f6b8d72d7cb'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.453151 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a3ce79c1084843b6a69f6b8d72d7cb'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.460284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a3ce79c1084843b6a69f6b8d72d7cb'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.467528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a3ce79c1084843b6a69f6b8d72d7cb'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:35.471356 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.472865 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57b0a-a56e-4f62-a8b1-878dd670dfba service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.473466 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1312/2621] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:35 2022] DELETE /identity/v3/users/67a3ce79c1084843b6a69f6b8d72d7cb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:35.474306 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.475655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.485607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1310/2622] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:35.486940 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.487232 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.487714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.505335 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:35.507221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.549965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ae65-f6f9-470e-a85b-cb2dfea7406b admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.555914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.557230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.557996 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.558425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.559231 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.560972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.571500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1313/2623] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:35.575754 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.579304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1311/2624] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:35.588148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.589572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.590475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382724cb-8ca9-4bcd-bbb5-ae0cdbd74efe admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.595324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.596245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.596245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.596493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.597240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.598800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.612499 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1314/2625] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:35.613719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.626601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74e42-79d3-4cb8-9d9c-046053132f0e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.632398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.633560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.633937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.634309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] PATH_INFO: `/v3/projects/e6758effb73344c895a7ed675378f8df/users/f0b99029c246448da0a2d0e26a16f43d/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.651615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6758effb73344c895a7ed675378f8df, user_id=f0b99029c246448da0a2d0e26a16f43d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.652630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3daba0-7edb-4535-a960-428a89c78ecb None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.654837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde37c8-3386-4477-8a3c-d913408cda1b admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.656623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.657225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.657507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.657782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.668077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.669367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1315/2626] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:35 2022] PUT /identity/v3/projects/e6758effb73344c895a7ed675378f8df/users/f0b99029c246448da0a2d0e26a16f43d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:35.669617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.674539 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.674902 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.675247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.679948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1312/2627] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:35.694396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:35.696010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.769384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1316/2628] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:35.780288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:35.782522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:35.798732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99a51-914a-4d99-9b31-5df7eba7ea75 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:35.869668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:35.870964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:35.871243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:35.871551 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:35.881353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:35.883782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:35.894515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1313/2629] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:36.053592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:36.055175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:36.066832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549101e-8754-4f9d-810a-35bd5527f6e6 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:36.071944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:36.073497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.073776 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.074049 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] PATH_INFO: `/v3/projects/2c361cdb8bd54b2fb6e07a4c5f0f2faf` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.075251 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c361cdb8bd54b2fb6e07a4c5f0f2faf)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:36.077194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:36.128618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c361cdb8bd54b2fb6e07a4c5f0f2faf', 'request_id': 'req-bfb12683-cf57-416e-9a29-38f109ebe051'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.134427 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c361cdb8bd54b2fb6e07a4c5f0f2faf', 'request_id': 'req-bfb12683-cf57-416e-9a29-38f109ebe051'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.141407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c361cdb8bd54b2fb6e07a4c5f0f2faf', 'request_id': 'req-bfb12683-cf57-416e-9a29-38f109ebe051'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.153835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] The token cache is being invalidate because project 2c361cdb8bd54b2fb6e07a4c5f0f2faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:36.154269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.154892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.156494 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1317/2630] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:36 2022] DELETE /identity/v3/projects/2c361cdb8bd54b2fb6e07a4c5f0f2faf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:36.160364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:36.170433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac863-6412-45ae-9ac2-e7f09a0202ec service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:36.229465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:36.230414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.230689 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.230950 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] PATH_INFO: `/v3/users/448f5edc3e7245009889cf007ca52db6` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.232369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448f5edc3e7245009889cf007ca52db6)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:36.234656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:36.293672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448f5edc3e7245009889cf007ca52db6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.294349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448f5edc3e7245009889cf007ca52db6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.308990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448f5edc3e7245009889cf007ca52db6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.318119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448f5edc3e7245009889cf007ca52db6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.318879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448f5edc3e7245009889cf007ca52db6'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.333288 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1314/2631] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:36 2022] DELETE /identity/v3/users/448f5edc3e7245009889cf007ca52db6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:36.618739 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:36.620345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:36.637578 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb12683-cf57-416e-9a29-38f109ebe051 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:36.702209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:36.703162 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.703555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.704173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] PATH_INFO: `/v3/projects/afa667f7b1e44e1fac684bf524e23833` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.705633 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa667f7b1e44e1fac684bf524e23833)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:36.707447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:36.757769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa667f7b1e44e1fac684bf524e23833', 'request_id': 'req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.767056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa667f7b1e44e1fac684bf524e23833', 'request_id': 'req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.777022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa667f7b1e44e1fac684bf524e23833', 'request_id': 'req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.794344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] The token cache is being invalidate because project afa667f7b1e44e1fac684bf524e23833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:36.795056 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.795741 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.798039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1318/2632] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:36 2022] DELETE /identity/v3/projects/afa667f7b1e44e1fac684bf524e23833 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:36.801930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:36.803383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:36.834844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9bf6-d11a-4a83-b680-ca47b928cfe2 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:36.907095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:36.908091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:36.908437 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:36.908772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] PATH_INFO: `/v3/users/0cbbda65817349a0ab96b134cab6e779` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:36.910020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbbda65817349a0ab96b134cab6e779)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:36.912008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:36.975724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbbda65817349a0ab96b134cab6e779'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.977230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbbda65817349a0ab96b134cab6e779'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.989786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbbda65817349a0ab96b134cab6e779'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.998160 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbbda65817349a0ab96b134cab6e779'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:36.998958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ea63a2ed-9c8d-4ae4-9130-51e0a0111b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbbda65817349a0ab96b134cab6e779'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.015673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1315/2633] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:36 2022] DELETE /identity/v3/users/0cbbda65817349a0ab96b134cab6e779 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:37.367925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.369928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:37.389037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae428-0a08-43b9-bb4a-baee1bcdc1cc admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.459746 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.460858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.461817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.462210 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] PATH_INFO: `/v3/projects/bb1a00492cf14f258f0ede57eae9d861` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.464293 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1a00492cf14f258f0ede57eae9d861)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.466323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.524625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1a00492cf14f258f0ede57eae9d861', 'request_id': 'req-b7873ed5-28d5-48c2-a8fc-38e4443b555a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.548410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1a00492cf14f258f0ede57eae9d861', 'request_id': 'req-b7873ed5-28d5-48c2-a8fc-38e4443b555a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.560674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1a00492cf14f258f0ede57eae9d861', 'request_id': 'req-b7873ed5-28d5-48c2-a8fc-38e4443b555a'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.572698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] The token cache is being invalidate because project bb1a00492cf14f258f0ede57eae9d861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:37.572985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.575928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-b7873ed5-28d5-48c2-a8fc-38e4443b555a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:37.577440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1319/2634] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:37 2022] DELETE /identity/v3/projects/bb1a00492cf14f258f0ede57eae9d861 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:37.584684 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.584966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.585275 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.612467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:37.613698 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:37.685495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1316/2635] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:37.693906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.694199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.694682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.716155 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:37.717372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:37.729286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1320/2636] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:37.733538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.743973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf6ca4-94c2-4201-a8e4-c74ced685ff8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.749788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.750452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.751165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.751165 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.751743 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:37.752045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.753685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.765934 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1317/2637] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:37.770644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.779897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401058-eefc-451e-bdfc-349d4b6125e9 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.784560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.785294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.785640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.785913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.786612 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.788527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.816434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1321/2638] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:37 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:37.821347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.832108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41364e-9c1a-4353-8d0b-1e950d252baa admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.898074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.899340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.899881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.900154 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.900850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.902765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.923617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1318/2639] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:37 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:37.927724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.937976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d7007-627b-4773-8024-6f531a81166c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.942897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.943622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.943893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.944167 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.944896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.947241 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.964194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1322/2640] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:37.967806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:37.978247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad635a-9dcf-4568-a2ba-8ca389357970 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:37.983258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:37.983980 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:37.984260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:37.984641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:37.985366 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:37.987050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f8960-395e-4dc9-a304-c41fe12aa360 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:37.997159 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1319/2641] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:38.002004 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:38.013039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1796-bd1c-440f-8c72-25c8eeff1002 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:38.017848 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:38.018762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.019047 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.019826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] PATH_INFO: `/v3/projects/560175f20bc248c1a97c21afb960d619/users/21062f7e57c44a1ea83b34dc5184eab3/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.037906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=560175f20bc248c1a97c21afb960d619, user_id=21062f7e57c44a1ea83b34dc5184eab3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:38.041286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:38.056740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1323/2642] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:38 2022] PUT /identity/v3/projects/560175f20bc248c1a97c21afb960d619/users/21062f7e57c44a1ea83b34dc5184eab3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:38.069104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.069389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.069855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.099818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] MFA Rules not processed for user `21062f7e57c44a1ea83b34dc5184eab3`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:38.101420 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.121213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:38.123323 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.187816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1320/2643] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:38.200966 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:38.204112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.213045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c766a88-2d91-4053-880c-7e3dac326cbe admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:38.230770 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:38.231763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.232038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.232310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] PATH_INFO: `/v3/users/7f1a8486356248d4b537f7d8de3854c9` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.233814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1a8486356248d4b537f7d8de3854c9)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:38.235792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:38.293019 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60ae3d-6273-4739-9fca-3212855dbb73 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:38.300723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:38.301404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.302409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.302692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.303703 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1a8486356248d4b537f7d8de3854c9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:38.304692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1a8486356248d4b537f7d8de3854c9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:38.318082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:38.319841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36446a8-e6c5-49cc-8064-2b3a964fb1f6 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:38.339299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1a8486356248d4b537f7d8de3854c9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:38.344202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1321/2644] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:38.354564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1a8486356248d4b537f7d8de3854c9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:38.369375 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1a8486356248d4b537f7d8de3854c9'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:38.380392 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1324/2645] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:38 2022] DELETE /identity/v3/users/7f1a8486356248d4b537f7d8de3854c9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:38.385547 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25197-c420-4175-9675-723bab36239e None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.385920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25197-c420-4175-9675-723bab36239e None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.386286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25197-c420-4175-9675-723bab36239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.432293 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-20f25197-c420-4175-9675-723bab36239e None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:38.433662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-20f25197-c420-4175-9675-723bab36239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.511107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1322/2646] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:38.520526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:38.522473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:38.610704 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b995ce-d336-49e0-a2f5-b469d20cc614 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:38.615094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:38.616076 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:38.616541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:38.617082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:38.634171 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:38.637404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:38.651134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1325/2647] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:39.109380 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25197-c420-4175-9675-723bab36239e None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:39.110869 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-20f25197-c420-4175-9675-723bab36239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:39.125818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25197-c420-4175-9675-723bab36239e None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:39.132582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:39.134086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:39.134364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:39.134633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] PATH_INFO: `/v3/projects/b38748e0fcfb4574b6b860aac33eaec7` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:39.135914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38748e0fcfb4574b6b860aac33eaec7)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:39.137945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:39.219530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38748e0fcfb4574b6b860aac33eaec7', 'request_id': 'req-a2ffc152-9f99-4914-8ff6-6cf229523fec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.230005 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38748e0fcfb4574b6b860aac33eaec7', 'request_id': 'req-a2ffc152-9f99-4914-8ff6-6cf229523fec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.236780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38748e0fcfb4574b6b860aac33eaec7', 'request_id': 'req-a2ffc152-9f99-4914-8ff6-6cf229523fec'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.255116 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] The token cache is being invalidate because project b38748e0fcfb4574b6b860aac33eaec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:39.255560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.256381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.259112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1323/2648] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:39 2022] DELETE /identity/v3/projects/b38748e0fcfb4574b6b860aac33eaec7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:39.262839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:39.276046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4c534-4238-4f26-8fce-b67e0a11d26f service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:39.343208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:39.344609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:39.344950 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:39.345175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] PATH_INFO: `/v3/users/c338b7d643fa483fb5fbf8afd0132e9e` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:39.346367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c338b7d643fa483fb5fbf8afd0132e9e)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:39.348351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:39.403023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c338b7d643fa483fb5fbf8afd0132e9e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.404097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c338b7d643fa483fb5fbf8afd0132e9e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.416967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c338b7d643fa483fb5fbf8afd0132e9e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.423807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c338b7d643fa483fb5fbf8afd0132e9e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.434055 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1c606dcd-6f51-42f1-8584-35cd87971327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c338b7d643fa483fb5fbf8afd0132e9e'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.443079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1326/2649] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:39 2022] DELETE /identity/v3/users/c338b7d643fa483fb5fbf8afd0132e9e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:39.769897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:39.771369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:39.800363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc152-9f99-4914-8ff6-6cf229523fec admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:39.879488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:39.881373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:39.881659 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:39.881929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] PATH_INFO: `/v3/projects/7022c9368cee407498f0840b8b4eca4c` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:39.883807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7022c9368cee407498f0840b8b4eca4c)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:39.886231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:39.962772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7022c9368cee407498f0840b8b4eca4c', 'request_id': 'req-602cc7d0-500e-4a13-b9dd-f243147463ce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.972225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7022c9368cee407498f0840b8b4eca4c', 'request_id': 'req-602cc7d0-500e-4a13-b9dd-f243147463ce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:39.983879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7022c9368cee407498f0840b8b4eca4c', 'request_id': 'req-602cc7d0-500e-4a13-b9dd-f243147463ce'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:40.004994 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] The token cache is being invalidate because project 7022c9368cee407498f0840b8b4eca4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:40.005373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:40.008816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-602cc7d0-500e-4a13-b9dd-f243147463ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:40.015931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1324/2650] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:39 2022] DELETE /identity/v3/projects/7022c9368cee407498f0840b8b4eca4c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:40.019149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.019464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.019743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.065798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:40.067026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:40.158127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1327/2651] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:40.167139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.167696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.168436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.192331 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:40.194367 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:40.205111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1325/2652] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:40.209938 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.220363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65bd63-57ba-43dd-b7ee-22025b7a1f41 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.225070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.225728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.226013 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.226283 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.227669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:40.227856 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.229462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.242887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1328/2653] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:40.246713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.257795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300ac5-c86b-4012-97b0-3114fd67abf3 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.267908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.268813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.269095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.269368 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.270114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.272199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.315631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1326/2654] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:40.316825 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.351717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e9501-fdb7-4451-90e6-f78fc04cf91e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.435275 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.436266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.437407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.438320 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.439176 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.441913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.466218 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1329/2655] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:40.470392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.481748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9046a-f548-46ae-891c-5f3447b57917 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.491315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.492432 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.492585 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.493460 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.495118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.497403 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.511401 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1327/2656] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:40.515418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.526965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd4c4-89b5-4c57-8cd8-da47b0f91975 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.531837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.532656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.532946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.533222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.533947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.536112 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96f30-a668-4195-b6a5-c62ad42d960d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.551386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1330/2657] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:40.552942 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.564831 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174c17-eab9-47a7-9d85-7168d0ebea40 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.571425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.572621 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.572949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.573554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] PATH_INFO: `/v3/projects/40f0c98076e34126a2aab59fc6dc9969/users/2097b1f37e3f4565bd6009821a33fa6e/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.591783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f0c98076e34126a2aab59fc6dc9969, user_id=2097b1f37e3f4565bd6009821a33fa6e, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.594556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.616595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1328/2658] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:40 2022] PUT /identity/v3/projects/40f0c98076e34126a2aab59fc6dc9969/users/2097b1f37e3f4565bd6009821a33fa6e/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:40.627595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b644-ac0b-4df9-b7c1-42bdc66e1026 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.628002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b644-ac0b-4df9-b7c1-42bdc66e1026 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.628279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b644-ac0b-4df9-b7c1-42bdc66e1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.663232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fe14b644-ac0b-4df9-b7c1-42bdc66e1026 None None] MFA Rules not processed for user `2097b1f37e3f4565bd6009821a33fa6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:40.664784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fe14b644-ac0b-4df9-b7c1-42bdc66e1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:40.745946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1331/2659] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:40.750657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.791308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.791609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.791887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.821090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] MFA Rules not processed for user `f0b99029c246448da0a2d0e26a16f43d`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:40.822452 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:40.835326 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b13f0-e94c-48b3-80a7-0e97f85fad87 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.840563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.844029 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.844319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.844595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.845582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.847571 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.876801 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1329/2660] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:40.880897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.894809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1332/2661] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:40.900373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.901934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:40.916382 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e83db-4d9b-4a01-8248-111a483ce2e1 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.947741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1127d0-e60a-4d1e-a680-f7d43a8c73b8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:40.953220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.953985 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.954352 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.954692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.955484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.957511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.979839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1330/2662] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:40.980665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:40.981351 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:40.981606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:40.981871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:40.982724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:40.983786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:40.984676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:40.995068 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc0012-45b5-4c03-ba96-186e7caeb889 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.000254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.000920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.001267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.001514 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.002289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.003853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.012458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1333/2663] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:40 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:41.015300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1331/2664] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:41.016557 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.018261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.028744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7785-85bd-449d-80b2-18570a350f8f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.084791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bbb90-d380-4e4c-92f3-44c2039fbdc0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.087391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.088286 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.088575 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.088844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] PATH_INFO: `/v3/projects/7dd540c74a8141c29873ddb494ba0690/users/890426fe9b214b368a58ca41a3e4e510/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.092464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.093577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.094018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.094300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.094998 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.097697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.105792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd540c74a8141c29873ddb494ba0690, user_id=890426fe9b214b368a58ca41a3e4e510, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.108502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.119868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1334/2665] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:41 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:41.123796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1332/2666] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:41 2022] PUT /identity/v3/projects/7dd540c74a8141c29873ddb494ba0690/users/890426fe9b214b368a58ca41a3e4e510/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:41.123995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.127240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.134521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f99274-838b-4d2a-9f46-4e321d5a363e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.193386 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e69545-ab2b-4638-bd48-614509f7939a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.194789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.196043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.196324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.196592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.197337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.198907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.199173 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.199602 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.199888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.200166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.200888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.202461 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.209040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1335/2667] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:41.210395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.212473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.212825 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1333/2668] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:41.213636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.223938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420f11b-2273-4063-8dea-1c983d1be4d4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.228397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531cef7-c5b9-4cb3-9676-ac7330f8670e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.228666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.229543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.229824 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.230106 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] PATH_INFO: `/v3/projects/fa899b4ee1304564bc11486c61a0ea66/users/2b50354768eb4011959150f1f1dc7323/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.233296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.234257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.234533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.234801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] PATH_INFO: `/v3/users/21062f7e57c44a1ea83b34dc5184eab3` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.236209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21062f7e57c44a1ea83b34dc5184eab3)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.238157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.245078 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa899b4ee1304564bc11486c61a0ea66, user_id=2b50354768eb4011959150f1f1dc7323, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.247914 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.261185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1334/2669] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:41 2022] PUT /identity/v3/projects/fa899b4ee1304564bc11486c61a0ea66/users/2b50354768eb4011959150f1f1dc7323/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:41.262035 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.285943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21062f7e57c44a1ea83b34dc5184eab3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.286601 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21062f7e57c44a1ea83b34dc5184eab3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.298308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21062f7e57c44a1ea83b34dc5184eab3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.305434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21062f7e57c44a1ea83b34dc5184eab3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.313640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21062f7e57c44a1ea83b34dc5184eab3'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.321875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1336/2670] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:41 2022] DELETE /identity/v3/users/21062f7e57c44a1ea83b34dc5184eab3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:41.323032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.325424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.327951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad4f2-bb5b-495e-9331-88fc85d5534d admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.382607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.384075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.384354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.384623 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] PATH_INFO: `/v3/projects/7dd540c74a8141c29873ddb494ba0690/users/890426fe9b214b368a58ca41a3e4e510/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.386588 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd540c74a8141c29873ddb494ba0690, user_id=890426fe9b214b368a58ca41a3e4e510, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.388287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90ae31-731b-4a82-8148-ce7bb862bd8d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.389281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db3a7-cc3f-4f74-aa44-da4c85bcaaa7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.392907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.393556 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.393850 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.394101 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.394811 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.396407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0905-ba17-4ae7-ab5e-97b8a1db784d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.400125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1335/2671] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:41 2022] PUT /identity/v3/projects/7dd540c74a8141c29873ddb494ba0690/users/890426fe9b214b368a58ca41a3e4e510/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:41.405425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.405425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.405425 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.406489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1337/2672] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:41.410818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.411097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.411406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.425816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:41.426955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.437948 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] MFA Rules not processed for user `890426fe9b214b368a58ca41a3e4e510`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:41.439140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.486143 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1336/2673] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:41.486841 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.498845 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1887-a5db-4ae1-8a10-6eb8c6d82613 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.503960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.504930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.505277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.505634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] PATH_INFO: `/v3/projects/fa899b4ee1304564bc11486c61a0ea66/users/2b50354768eb4011959150f1f1dc7323/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.507842 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1338/2674] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:41.507973 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa899b4ee1304564bc11486c61a0ea66, user_id=2b50354768eb4011959150f1f1dc7323, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.508530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.510733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.511983 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.526423 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1337/2675] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:41 2022] PUT /identity/v3/projects/fa899b4ee1304564bc11486c61a0ea66/users/2b50354768eb4011959150f1f1dc7323/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:41.527405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.529404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.586041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621cdb-9777-454b-a46f-ff16288cc39b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.597342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571309c-7946-4457-a7db-499f2e1d149c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.601466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.602786 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.603166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.603567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.639006 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.639846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.640125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.640393 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.672327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.673806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.685238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1338/2676] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:41.706700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.708656 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9387bcb-3d50-40bd-9a10-dfe9cecc5480 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.719141 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1339/2677] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:41.844264 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:41.846000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:41.869114 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35fcb-73a2-4825-9368-42517d2c707a service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:41.874952 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:41.876895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:41.877704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:41.877704 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] PATH_INFO: `/v3/users/2097b1f37e3f4565bd6009821a33fa6e` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:41.879147 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2097b1f37e3f4565bd6009821a33fa6e)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:41.881101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:41.972239 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2097b1f37e3f4565bd6009821a33fa6e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:41.973247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2097b1f37e3f4565bd6009821a33fa6e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.001224 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2097b1f37e3f4565bd6009821a33fa6e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.012141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2097b1f37e3f4565bd6009821a33fa6e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.013123 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2097b1f37e3f4565bd6009821a33fa6e'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.034175 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1339/2678] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:41 2022] DELETE /identity/v3/users/2097b1f37e3f4565bd6009821a33fa6e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:42.036174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.036591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.036936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.055039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:42.056615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.128305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1340/2679] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:42.137565 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.139472 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.214520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33f69-697d-4643-b749-95328841fb4a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.221765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.222902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.223456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.223909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.236644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.239379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b51b5-bdba-4a81-8ba3-9a3340766c94 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.250599 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1340/2680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:42.271230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.272896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.293209 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3e657-04aa-4706-af24-6f4cc072861c None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.302742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.303640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.303926 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.304194 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] PATH_INFO: `/v3/projects/560175f20bc248c1a97c21afb960d619` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.308930 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560175f20bc248c1a97c21afb960d619)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.310889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.392610 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560175f20bc248c1a97c21afb960d619', 'request_id': 'req-fe664305-a961-4143-ab69-253b55bf80b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.400238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560175f20bc248c1a97c21afb960d619', 'request_id': 'req-fe664305-a961-4143-ab69-253b55bf80b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.409772 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560175f20bc248c1a97c21afb960d619', 'request_id': 'req-fe664305-a961-4143-ab69-253b55bf80b5'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.428781 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] The token cache is being invalidate because project 560175f20bc248c1a97c21afb960d619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:42.429288 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.434199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-fe664305-a961-4143-ab69-253b55bf80b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.436917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1341/2681] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:42 2022] DELETE /identity/v3/projects/560175f20bc248c1a97c21afb960d619 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:42.442391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.442688 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.442955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.495753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:42.497921 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.582125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1341/2682] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:42.591913 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.592670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.592670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.646095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:42.647723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.652113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.653744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.663692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1342/2683] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:42.664865 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.670792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b604ee-021a-4d60-8a44-e824ef585b3f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.679092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491a9c-b0f6-4bd5-afd7-baff095e9193 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.680846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.681815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.682350 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.682719 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] PATH_INFO: `/v3/projects/40f0c98076e34126a2aab59fc6dc9969` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.684022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f0c98076e34126a2aab59fc6dc9969)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.686396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.686636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.687699 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.688150 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.688560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.689430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:42.690082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.692213 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.713223 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1343/2684] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:42.714737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.725464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db890a-a8be-45ad-a8ab-fdf968be89c0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.732546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.733239 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.734520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.734520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.736911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.741833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.775557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f0c98076e34126a2aab59fc6dc9969', 'request_id': 'req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.786894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1344/2685] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:42 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:42.787678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f0c98076e34126a2aab59fc6dc9969', 'request_id': 'req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.788962 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.794417 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f0c98076e34126a2aab59fc6dc9969', 'request_id': 'req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.806696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] The token cache is being invalidate because project 40f0c98076e34126a2aab59fc6dc9969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:42.807180 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.807983 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.809768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1342/2686] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:42 2022] DELETE /identity/v3/projects/40f0c98076e34126a2aab59fc6dc9969 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:42.813805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.816069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.872951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809ab6f-3337-48a2-9209-c80c3ec2d5cb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.881360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.882631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.883702 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.884130 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.884994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.887401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.894566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4ebec-b2f8-4ade-b9c5-7d1748263c07 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.902734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.904476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.905074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.905202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] PATH_INFO: `/v3/users/890426fe9b214b368a58ca41a3e4e510` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.906676 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890426fe9b214b368a58ca41a3e4e510)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.909146 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.929418 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1345/2687] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:42 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:42.931183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.934321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:42.954482 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa66f-007f-4a70-81b2-5f0033c1c358 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:42.962018 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:42.963087 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:42.963778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:42.963778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:42.965484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:42.967188 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:42.976108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890426fe9b214b368a58ca41a3e4e510'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.977750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890426fe9b214b368a58ca41a3e4e510'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:42.985751 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1346/2688] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:42.986712 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:42.993395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890426fe9b214b368a58ca41a3e4e510'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.001458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8728cdf-a7f9-4d40-8d87-bbafef4a117e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.001850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890426fe9b214b368a58ca41a3e4e510'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.003203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890426fe9b214b368a58ca41a3e4e510'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.010644 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.011972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.012407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.012498 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.013286 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.019097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8380d3-1e8c-48a4-a687-5677db10c931 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:43.029219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1343/2689] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:42 2022] DELETE /identity/v3/users/890426fe9b214b368a58ca41a3e4e510 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:43.036243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1347/2690] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:43.041195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:43.042776 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.128202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd7896-1498-4a56-b133-bdf34cec6144 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.135110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.136813 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.137198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.137578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] PATH_INFO: `/v3/projects/549cd5f2cff143c69dd1e4568d7bd3e6/users/94cdac893464447ea8753d29ac7c629b/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.155176 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549cd5f2cff143c69dd1e4568d7bd3e6, user_id=94cdac893464447ea8753d29ac7c629b, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.158118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:43.183885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1344/2691] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:43 2022] PUT /identity/v3/projects/549cd5f2cff143c69dd1e4568d7bd3e6/users/94cdac893464447ea8753d29ac7c629b/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:43.196973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.196973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.196973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.234624 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:43.236609 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.331629 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1348/2692] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:43.343450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:43.345309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.433587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:43.436947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.442899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292b549-0636-48d6-9011-a3d9109d5080 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.446907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.448995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.449440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.449904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.463882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78b48-0c92-43e8-ab97-364c988f83c4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.467276 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.468840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801803-98f6-49cf-ba0f-0be434bc197b service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:43.469415 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.470421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.470832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.471115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] PATH_INFO: `/v3/projects/7dd540c74a8141c29873ddb494ba0690` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.481026 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd540c74a8141c29873ddb494ba0690)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.484165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:43.493606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1345/2693] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:43.572497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd540c74a8141c29873ddb494ba0690', 'request_id': 'req-98a699ba-e660-4202-9413-c9a826ac86fa'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.589123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd540c74a8141c29873ddb494ba0690', 'request_id': 'req-98a699ba-e660-4202-9413-c9a826ac86fa'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.597724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd540c74a8141c29873ddb494ba0690', 'request_id': 'req-98a699ba-e660-4202-9413-c9a826ac86fa'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.619041 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] The token cache is being invalidate because project 7dd540c74a8141c29873ddb494ba0690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:43.619708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.620648 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-98a699ba-e660-4202-9413-c9a826ac86fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:43.623787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1349/2694] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:43 2022] DELETE /identity/v3/projects/7dd540c74a8141c29873ddb494ba0690 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:43.629047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.629603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.629770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.660385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:43.663464 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.797052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1346/2695] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:43.877643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.878681 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.878977 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.914936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:43.920561 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:43.942357 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1350/2696] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:43.946474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:43.963404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92786d86-016f-455f-a7cd-bd24f278dfbf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:43.978246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:43.978941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:43.979220 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:43.979522 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:43.981156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:43.981470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:43.983111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.008112 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1347/2697] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:44.013260 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.024989 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9b35-7431-4c5e-b495-17498d54d62b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.029762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.030424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.030705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.030982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.031925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.033846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.064959 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1351/2698] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:44 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:44.069092 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.080237 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438faa-e937-4c08-ae16-005e5eb4aefb admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.144739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.145748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.146027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.146299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.146990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.150347 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.196303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1348/2699] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:44 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:44.199617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.211574 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179ce6-c877-4f7b-abb5-aff3c7d645f6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.230689 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.231407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.231685 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.231951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.232675 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.234318 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.286395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.303535 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1352/2700] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:44.305528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a343524-7aa1-4dac-870e-068ef5dd7769 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.314938 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.315854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.316032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.316369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.317629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.319381 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c47247-b56e-478e-964d-5769b6694f94 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.331666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1349/2701] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:44.335765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.348964 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c21a-b29b-4651-b499-9e96a74a6f0a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.359045 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.359995 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.360274 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.360549 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] PATH_INFO: `/v3/projects/d40c88b116564260b68a14367794f226/users/ba5a778c70de471e89a925308677f4c3/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.380299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40c88b116564260b68a14367794f226, user_id=ba5a778c70de471e89a925308677f4c3, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.384424 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.415933 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1353/2702] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:44 2022] PUT /identity/v3/projects/d40c88b116564260b68a14367794f226/users/ba5a778c70de471e89a925308677f4c3/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:44.426645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.427103 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.427572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.495578 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] MFA Rules not processed for user `ba5a778c70de471e89a925308677f4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:44.501051 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:44.622340 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1350/2703] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:44.624015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.735225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a301f2-e9e9-4d14-85cc-137af2db739d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.746395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.747312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.747762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.748669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.749611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.752413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.796719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1354/2704] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:44 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:47:44.800693 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:44.813376 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcfa96-8111-434e-92e7-c5bbb095b44b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:44.934487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:44.936137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:44.952135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:44.952424 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:44.953192 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:44.955173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:44.998500 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1351/2705] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:44 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:44.998918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:45.044048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d8b2d-d770-46cc-9fe3-f88b4fd83fc9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:45.065800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:45.066491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.066775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.068730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.069647 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:45.077735 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:45.101380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1355/2706] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:45.106467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:45.120466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4d11-f637-486c-bc05-b6db16094ef9 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:45.125949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:45.127775 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.128185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.128566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] PATH_INFO: `/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c/users/21b62cea84a64a04b18e6b8f0c303515/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.151751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae249cd5bf3140d0a58997a9c623ba6c, user_id=21b62cea84a64a04b18e6b8f0c303515, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:45.159042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:45.200597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1352/2707] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:45 2022] PUT /identity/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c/users/21b62cea84a64a04b18e6b8f0c303515/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:45.205882 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:45.231830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5bfe-52a2-4714-9e32-c002d58fec82 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:45.349906 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:45.350599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.351308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.351308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.352464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:45.354166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ccd2-0955-4507-b369-53c1ab9c0e17 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:45.370377 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1356/2708] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:45.374408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:45.387892 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd853518-9231-4788-b01e-4b6c4353d865 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:45.401557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:45.402874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.403402 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.403864 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] PATH_INFO: `/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c/users/21b62cea84a64a04b18e6b8f0c303515/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.406415 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae249cd5bf3140d0a58997a9c623ba6c, user_id=21b62cea84a64a04b18e6b8f0c303515, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:45.409818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:45.422666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1353/2709] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:45 2022] PUT /identity/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c/users/21b62cea84a64a04b18e6b8f0c303515/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:45.433022 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca305b-ad44-4ae4-b5d6-8ba43f468559 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.433897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca305b-ad44-4ae4-b5d6-8ba43f468559 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.433897 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca305b-ad44-4ae4-b5d6-8ba43f468559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.466106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-20ca305b-ad44-4ae4-b5d6-8ba43f468559 None None] MFA Rules not processed for user `21b62cea84a64a04b18e6b8f0c303515`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:45.467380 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-20ca305b-ad44-4ae4-b5d6-8ba43f468559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:45.546480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1357/2710] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:45.560360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:45.562412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:45.699753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4192986-99f5-45d4-b3a3-c356c6b7a219 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:45.709333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:45.710003 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:45.710280 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:45.710550 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:45.869516 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:45.872284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:45.893579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1354/2711] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:47:48.787514 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:48.788031 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:48.788145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:48.827807 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] MFA Rules not processed for user `2b50354768eb4011959150f1f1dc7323`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:48.829054 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:48.925139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:48.937123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1358/2712] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:48.946631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:48.949705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:49.023988 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63ddc-39a8-49d9-95a8-a1a26ae9f2d2 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:49.031644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:49.032559 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:49.033566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:49.034281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] PATH_INFO: `/v3/users/ba5a778c70de471e89a925308677f4c3` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:49.035609 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5a778c70de471e89a925308677f4c3)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:49.038260 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:49.091489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23b787-7052-46a9-83f3-b141d1c8148b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:49.097588 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:49.098477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:49.098971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:49.099475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:49.102292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:49.107299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5a778c70de471e89a925308677f4c3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:49.112265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5a778c70de471e89a925308677f4c3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:49.132128 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5a778c70de471e89a925308677f4c3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:49.147986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5a778c70de471e89a925308677f4c3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:49.148882 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-07e4beea-69c6-4f40-9131-fefd914af2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5a778c70de471e89a925308677f4c3'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:49.185148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1355/2713] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:48 2022] DELETE /identity/v3/users/ba5a778c70de471e89a925308677f4c3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:49.186747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:49.187071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:49.187428 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:49.206954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:49.208202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:49.216356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:49.217976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:49.231761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1359/2714] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:49.341658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1356/2715] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:49.351078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:49.352731 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:49.468864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8346c8-aa76-47cb-b4f9-549e0b05f7dc service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:49.548490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:49.550412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:49.550412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:49.550412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:49.568376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:49.571238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:49.587365 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1360/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:49.967656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:49.969449 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:49.992004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc832-2ca8-463d-a5d3-dc884139eeaf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:50.000651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:50.002174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.002679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.003370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] PATH_INFO: `/v3/projects/d40c88b116564260b68a14367794f226` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.005269 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40c88b116564260b68a14367794f226)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:50.007859 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:50.067178 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40c88b116564260b68a14367794f226', 'request_id': 'req-1e259268-d581-40b2-a76b-d60557a69f4b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.077752 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40c88b116564260b68a14367794f226', 'request_id': 'req-1e259268-d581-40b2-a76b-d60557a69f4b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.084915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40c88b116564260b68a14367794f226', 'request_id': 'req-1e259268-d581-40b2-a76b-d60557a69f4b'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.104127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] The token cache is being invalidate because project d40c88b116564260b68a14367794f226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:50.104454 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.105737 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-1e259268-d581-40b2-a76b-d60557a69f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.110456 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1357/2717] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:49 2022] DELETE /identity/v3/projects/d40c88b116564260b68a14367794f226 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:50.112133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:50.128277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898077-63eb-431c-9c59-63661a05fd09 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:50.221678 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:50.222728 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:50.223079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:50.223448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] PATH_INFO: `/v3/users/21b62cea84a64a04b18e6b8f0c303515` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:50.225387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b62cea84a64a04b18e6b8f0c303515)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:50.229010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:50.331533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b62cea84a64a04b18e6b8f0c303515'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.332695 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b62cea84a64a04b18e6b8f0c303515'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.364911 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b62cea84a64a04b18e6b8f0c303515'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.389733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b62cea84a64a04b18e6b8f0c303515'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.409799 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b62cea84a64a04b18e6b8f0c303515'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:50.428146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1361/2718] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:50 2022] DELETE /identity/v3/users/21b62cea84a64a04b18e6b8f0c303515 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:51.228858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97c97-3981-497c-b94d-58274f57801f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.229435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97c97-3981-497c-b94d-58274f57801f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.234711 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97c97-3981-497c-b94d-58274f57801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.268056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1fd97c97-3981-497c-b94d-58274f57801f None None] MFA Rules not processed for user `f0b99029c246448da0a2d0e26a16f43d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.290755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1fd97c97-3981-497c-b94d-58274f57801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.315510 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:51.317123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.435108 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1358/2719] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:51.435542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.436013 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.436299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.509493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88212-b5ae-456b-882c-7d23082b066f admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:51.518881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] MFA Rules not processed for user `94cdac893464447ea8753d29ac7c629b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.520099 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:51.520247 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.520988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.521269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.521541 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] PATH_INFO: `/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.522744 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae249cd5bf3140d0a58997a9c623ba6c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:51.527797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:51.648044 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae249cd5bf3140d0a58997a9c623ba6c', 'request_id': 'req-3b52623d-bd14-4d39-a4b8-596aabd18f76'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:51.655586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae249cd5bf3140d0a58997a9c623ba6c', 'request_id': 'req-3b52623d-bd14-4d39-a4b8-596aabd18f76'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:51.670932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae249cd5bf3140d0a58997a9c623ba6c', 'request_id': 'req-3b52623d-bd14-4d39-a4b8-596aabd18f76'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:51.704141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1359/2720] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:51.712379 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:51.713451 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] The token cache is being invalidate because project ae249cd5bf3140d0a58997a9c623ba6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:51.713912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:51.714770 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.715075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3b52623d-bd14-4d39-a4b8-596aabd18f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:51.721592 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1362/2721] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:51 2022] DELETE /identity/v3/projects/ae249cd5bf3140d0a58997a9c623ba6c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:51.730309 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da596e-6a25-4210-8416-5898a1f022a1 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.740660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da596e-6a25-4210-8416-5898a1f022a1 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.740660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da596e-6a25-4210-8416-5898a1f022a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.748564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cfd0b-90d7-4509-b6bb-32777ad43f7d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:51.777272 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c9da596e-6a25-4210-8416-5898a1f022a1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.778646 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c9da596e-6a25-4210-8416-5898a1f022a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.901259 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:51.902027 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.903089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.903363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.904470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:51.907318 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:51.922221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1363/2722] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:51.931224 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:51.936221 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:51.936516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:51.965762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1360/2723] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:51.969662 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:51.972121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:51.973004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:51.978305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:52.096530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910899d-3ea7-47d0-9689-3517581939ba admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.106830 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.110502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.111008 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.111828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.112874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.115101 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.132489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1364/2724] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:52.136851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.156264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90817c0-8587-417a-a93d-4c71bd74ecb3 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.162223 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1361/2725] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:51 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:52.162951 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.163296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.163608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.164419 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.164619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.165307 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:47:52.165617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.167312 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.182468 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1365/2726] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:47:52.192998 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7733b-7a6e-4ce5-a5ab-9340579f21ee admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.200569 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.206410 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.209837 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.210433 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.211117 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.212122 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.214319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.233897 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1362/2727] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:52.234991 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e004bd-1ef8-4654-abe9-ee904e265a03 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.237705 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.249289 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.249958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.250233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.250504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.251191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.253122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.263629 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb667f5-ace4-4630-9492-b5e994fd6f59 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.276751 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.280362 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.280677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.280965 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] PATH_INFO: `/v3/projects/7d282e90f748416c8a2a2cae914bc1f7/users/c3f5480dfddc45a88cd579f7cf12fd29/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.315520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1366/2728] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:47:52 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:52.319413 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.329396 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d282e90f748416c8a2a2cae914bc1f7, user_id=c3f5480dfddc45a88cd579f7cf12fd29, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.336811 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.367389 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1363/2729] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:52 2022] PUT /identity/v3/projects/7d282e90f748416c8a2a2cae914bc1f7/users/c3f5480dfddc45a88cd579f7cf12fd29/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:52.369141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.432282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf705c-753c-4690-bc81-956c960d134d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.486409 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3888-e61d-449f-909f-6137948749e1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.492573 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.493253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.493533 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.493805 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.494526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.496435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.500305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.501163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.501550 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.501928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.502729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.505038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.520487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1364/2730] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:52.521518 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.533314 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2437-f9d2-4489-9654-3dd0a193940a admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.535816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1367/2731] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:47:52 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:47:52.538243 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.540792 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.541617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.541900 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.542322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] PATH_INFO: `/v3/projects/7d282e90f748416c8a2a2cae914bc1f7/users/c3f5480dfddc45a88cd579f7cf12fd29/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.545077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d282e90f748416c8a2a2cae914bc1f7, user_id=c3f5480dfddc45a88cd579f7cf12fd29, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.547894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.557917 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9cf1-3850-4e82-9356-d3a0ae111eb9 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.567319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1365/2732] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:52 2022] PUT /identity/v3/projects/7d282e90f748416c8a2a2cae914bc1f7/users/c3f5480dfddc45a88cd579f7cf12fd29/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:52.674428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.675480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.675907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.676407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.677385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.679431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.692001 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1368/2733] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:47:52.696499 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.712434 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9e389-ae2a-46d4-9339-fae5bfc7614b admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.722908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.723667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.723987 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.724311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.725638 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.728818 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7657-d110-4d03-bb54-c41020f444cb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.744124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1366/2734] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:47:52.747937 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:52.760378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fad21f-f6f8-4f36-94d2-307d733ab65a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:52.771862 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:52.773266 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.774163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.774489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] PATH_INFO: `/v3/projects/7cae3059ad1741ff846ff6df7efde0e7/users/08acda178d124cd19d19721243f204cc/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.804894 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cae3059ad1741ff846ff6df7efde0e7, user_id=08acda178d124cd19d19721243f204cc, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:52.807895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:52.830129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1369/2735] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:47:52 2022] PUT /identity/v3/projects/7cae3059ad1741ff846ff6df7efde0e7/users/08acda178d124cd19d19721243f204cc/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:52.842678 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:52.842975 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:52.843816 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:52.905714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] MFA Rules not processed for user `08acda178d124cd19d19721243f204cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:52.907105 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:53.014262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1367/2736] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:53.028665 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:53.030552 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:53.135128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0331-66ee-454d-8d0f-502129b6f4a0 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:53.140439 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:53.141263 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:53.141627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:53.142066 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:53.159480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:53.161024 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ec6f8-e207-46a4-9cc1-96a5f3098b5b service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:53.197431 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1370/2737] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:56.756643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:56.862570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f25b-cafe-417b-abb8-8c2c22127c68 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:56.867894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:56.871679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:56.871679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:56.871679 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] PATH_INFO: `/v3/users/08acda178d124cd19d19721243f204cc` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:56.874666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08acda178d124cd19d19721243f204cc)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:56.876319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:56.937569 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08acda178d124cd19d19721243f204cc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:56.941798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08acda178d124cd19d19721243f204cc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:56.957133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08acda178d124cd19d19721243f204cc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:56.964858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08acda178d124cd19d19721243f204cc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:56.965591 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08acda178d124cd19d19721243f204cc'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:56.988809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1368/2738] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:47:56 2022] DELETE /identity/v3/users/08acda178d124cd19d19721243f204cc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:47:56.995957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:56.996443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:56.996670 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:57.034145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:57.035383 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:57.119165 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1371/2739] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:47:57.129739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:57.131353 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:57.213166 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d700-b879-4335-8149-94b8bbebb4c4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:57.218543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:57.219296 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:57.219655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:57.219999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:57.231291 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:57.232910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56702b78-8d44-4436-9873-8c8c31465bc8 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:57.248172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1369/2740] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:47:57.809683 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:57.811669 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:57.832295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a5209-8405-4227-aa67-c25429ec810b None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:57.837896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:57.839304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:57.839304 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:57.839874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] PATH_INFO: `/v3/projects/7cae3059ad1741ff846ff6df7efde0e7` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:57.841485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cae3059ad1741ff846ff6df7efde0e7)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:57.844343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:57.860495 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07f8f-f4f5-48c5-a4c4-dacecd95d0d8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:57.861339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07f8f-f4f5-48c5-a4c4-dacecd95d0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:57.861799 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f07f8f-f4f5-48c5-a4c4-dacecd95d0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:57.893916 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a5f07f8f-f4f5-48c5-a4c4-dacecd95d0d8 None None] MFA Rules not processed for user `c3f5480dfddc45a88cd579f7cf12fd29`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:47:57.895360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a5f07f8f-f4f5-48c5-a4c4-dacecd95d0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:57.906483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cae3059ad1741ff846ff6df7efde0e7', 'request_id': 'req-565c8efb-68d7-4f92-b634-a44efee87592'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:57.917256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cae3059ad1741ff846ff6df7efde0e7', 'request_id': 'req-565c8efb-68d7-4f92-b634-a44efee87592'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:57.923974 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cae3059ad1741ff846ff6df7efde0e7', 'request_id': 'req-565c8efb-68d7-4f92-b634-a44efee87592'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:57.937602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] The token cache is being invalidate because project 7cae3059ad1741ff846ff6df7efde0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:47:57.937973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:57.938765 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:47:57.940577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1372/2741] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:47:57 2022] DELETE /identity/v3/projects/7cae3059ad1741ff846ff6df7efde0e7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:47:57.976429 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1370/2742] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:47:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:47:57.990986 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:47:57.992538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:58.089622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8efb-68d7-4f92-b634-a44efee87592 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:47:58.100222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:47:58.100963 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:47:58.101284 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:47:58.101597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:47:58.103692 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:47:58.203864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:47:58.205676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:47:58.217200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1373/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:48:19.023186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:19.024325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:19.024325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:19.041075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] MFA Rules not processed for user `94cdac893464447ea8753d29ac7c629b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:19.042262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:19.049059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1371/2744] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:48:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:48:28.104038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:28.105420 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:28.157705 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330f87-2d65-4a5f-9d08-eb363a5aa7df service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:28.161287 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:28.161925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:28.162227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:28.162497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:28.164753 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:28.223404 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:28.224840 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0f88f-6e58-461c-9cdb-cc1214c6eaed service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:28.234698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1374/2745] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:48:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:42.225436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:48:42.235507 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ad6dd-7c3b-4afa-87dd-894037af5877 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:48:42.238968 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:48:42.239628 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:42.239910 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:42.240184 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:42.248959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:48:42.250397 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:48:42.260156 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1372/2746] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:48:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:48:51.122184 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:48:51.122760 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:48:51.122866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:48:51.139523 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] MFA Rules not processed for user `4974777a05b64dbcb3550b74b9f39dee`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:48:51.140718 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:48:51.196131 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1375/2747] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:48:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:49:42.028118 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:42.029505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:42.084660 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fb59-72f8-4374-88de-d3c21fa06064 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:42.088405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:42.089041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:42.089320 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:42.089595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:42.091329 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:42.104687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:42.106079 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:42.116631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1373/2748] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:49:51.270446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:49:51.271831 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:51.283985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423f8c1-9593-4dec-a3ed-484658211865 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:49:51.287491 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:49:51.288114 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:49:51.288388 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:49:51.288655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:49:51.290285 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:49:51.303674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:49:51.305074 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:49:51.315618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1376/2749] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:49:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:06.478654 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:06.490635 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726498d4-2b0f-4058-a00a-3d7348a2ac75 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:06.496484 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:06.497307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:06.497990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:06.498266 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:06.500127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:06.513924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:06.528245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:06.541697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1374/2750] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:09.050733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:09.060473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075147-50da-47ce-8b4e-bfe8e4d833d0 service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:09.064416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:09.065129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:09.065460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:09.065929 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:09.067888 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:09.078081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:09.079529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:09.087253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1377/2751] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:15.401155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:15.403222 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:15.472261 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c118-133d-42da-8cfb-0d41ee688c57 service nova] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:15.476959 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:15.477842 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:15.478125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:15.478394 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] PATH_INFO: `/v3/users/4974777a05b64dbcb3550b74b9f39dee` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:15.479753 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4974777a05b64dbcb3550b74b9f39dee)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:15.482333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:15.532981 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4974777a05b64dbcb3550b74b9f39dee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.533633 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4974777a05b64dbcb3550b74b9f39dee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.545577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4974777a05b64dbcb3550b74b9f39dee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.552345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4974777a05b64dbcb3550b74b9f39dee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.553009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-d2285abe-1c67-47bf-81fa-682ded3749c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4974777a05b64dbcb3550b74b9f39dee'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.566230 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1375/2752] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:15 2022] DELETE /identity/v3/users/4974777a05b64dbcb3550b74b9f39dee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:15.736724 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:15.748106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb12c4-f3e4-4d27-b313-5b3235809f72 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:15.803600 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:15.804387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:15.804660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:15.804928 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] PATH_INFO: `/v3/projects/ec5def7947c243698109bfc891b0992f` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:15.806068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5def7947c243698109bfc891b0992f)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:15.808040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:15.852708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5def7947c243698109bfc891b0992f', 'request_id': 'req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.857783 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5def7947c243698109bfc891b0992f', 'request_id': 'req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.864198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5def7947c243698109bfc891b0992f', 'request_id': 'req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.875653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] The token cache is being invalidate because project ec5def7947c243698109bfc891b0992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:15.875934 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.876529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-db8d6fa3-6f73-4d52-8b53-4a96a6bc0841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:15.878299 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1378/2753] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:15 2022] DELETE /identity/v3/projects/ec5def7947c243698109bfc891b0992f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:15.883238 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:15.883555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:15.883858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:15.901228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:15.903032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:15.960226 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1376/2754] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:15.968219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:15.968508 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:15.968779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:15.986295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:15.987505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:15.995123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1379/2755] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:15.999584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.008963 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600e72-47f5-495a-932f-7d399f26b684 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.014252 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.014895 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.015177 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.015487 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.016229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:50:16.016535 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.018111 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.029733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1377/2756] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:50:16.033804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.043257 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c935e-c551-4d4c-9806-93632ce70f99 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.048040 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.048682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.048960 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.049234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.049927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.051849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.077278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1380/2757] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:16 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:16.081363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.091681 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8a98-4b66-4db0-817a-020f82542e80 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.147856 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.148526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.148807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.149082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.149767 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.152219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.171850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1378/2758] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:16 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:50:16.176012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.185879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e446f-cba4-4afe-a321-1bc70272a352 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.190371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.191010 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.191310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.191584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.192294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.193869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.204037 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1381/2759] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:16.207747 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.218182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253d8fe-c2a8-484e-a403-d26e34acee61 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.222651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.223327 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.223611 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.223886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.224598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.226168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab3530-0d45-453f-8d55-48090c1b06b9 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.236640 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1379/2760] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:16.240593 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.250075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9343d-25b5-459b-8f28-ae78935587f6 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.254623 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.255507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.255782 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.256051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] PATH_INFO: `/v3/projects/8523f918209142d1ac87d640aca35e01/users/7b1089a05ca74ff8aeee009f92eca35d/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.269708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8523f918209142d1ac87d640aca35e01, user_id=7b1089a05ca74ff8aeee009f92eca35d, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.272480 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.285429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1382/2761] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:16 2022] PUT /identity/v3/projects/8523f918209142d1ac87d640aca35e01/users/7b1089a05ca74ff8aeee009f92eca35d/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:16.290528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf361b-d5ee-4454-b8f5-95be8e514985 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.290814 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf361b-d5ee-4454-b8f5-95be8e514985 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.291089 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf361b-d5ee-4454-b8f5-95be8e514985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.308685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-2bcf361b-d5ee-4454-b8f5-95be8e514985 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:16.309848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-2bcf361b-d5ee-4454-b8f5-95be8e514985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:16.369375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1380/2762] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:50:16.378805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:16.380470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:16.435571 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d3d6-d62e-4235-b4e0-043722d21822 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:16.439187 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:16.439883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:16.440158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:16.440426 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:16.449655 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:16.451416 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:16.460640 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1383/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:17.070076 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.070631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.070631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.096148 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] MFA Rules not processed for user `7b1089a05ca74ff8aeee009f92eca35d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:17.097344 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:17.162300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1381/2764] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:17.166720 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.176591 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8eaf-fecf-4e74-892a-069a5ab600fa service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.181136 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.181805 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.182082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.182356 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.183639 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.185515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.213492 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1384/2765] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:17 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:17.214903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.225485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79a2d4-b5cc-468c-a8be-a7026192963f None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.281598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.282174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.282458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.282729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.283463 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.285363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.309073 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1382/2766] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:17 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:17.311931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.322270 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b5ee-38a2-4c40-97cc-addc91db6a78 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.327192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.328072 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.328219 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.328460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.329149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.330755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.341946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1385/2767] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:17.346109 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.357025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ccc2-eeea-4bec-bec1-c69305539b17 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.361885 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.362857 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.363210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.363584 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] PATH_INFO: `/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71/users/ef3cf1742ac342af98e92dd176708653/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.379398 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3fd06b29784e08a9077b9f7c63bb71, user_id=ef3cf1742ac342af98e92dd176708653, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.382075 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.394596 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1383/2768] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:17 2022] PUT /identity/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71/users/ef3cf1742ac342af98e92dd176708653/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:17.398461 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.408979 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55640df-3dcf-4e74-905e-24e40419ed20 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.463687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.464874 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.465147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.465411 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.466111 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.467714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579df5-6ad7-40a8-afa8-c26fe3309c62 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.476976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1386/2769] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:17.481758 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:17.491930 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546bd7-7a4e-49d8-9fb7-3d071b2d939e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:17.496497 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:17.497365 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:17.497645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:17.497917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] PATH_INFO: `/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71/users/ef3cf1742ac342af98e92dd176708653/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:17.499875 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3fd06b29784e08a9077b9f7c63bb71, user_id=ef3cf1742ac342af98e92dd176708653, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:17.502455 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:17.512290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1384/2770] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:17 2022] PUT /identity/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71/users/ef3cf1742ac342af98e92dd176708653/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:18.095145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:18.095457 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:18.095729 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:18.123625 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] MFA Rules not processed for user `ef3cf1742ac342af98e92dd176708653`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:18.124846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:18.194208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1387/2771] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:19.174458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:19.234586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a97b4-a727-42a5-9f0a-8a74a50cf86e admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:19.239090 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:19.239970 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:19.240246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:19.240513 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] PATH_INFO: `/v3/users/7b1089a05ca74ff8aeee009f92eca35d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:19.241696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1089a05ca74ff8aeee009f92eca35d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:19.243619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:19.288187 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1089a05ca74ff8aeee009f92eca35d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.288828 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1089a05ca74ff8aeee009f92eca35d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.300729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1089a05ca74ff8aeee009f92eca35d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.307183 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1089a05ca74ff8aeee009f92eca35d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.307951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1089a05ca74ff8aeee009f92eca35d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.324932 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1385/2772] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:19 2022] DELETE /identity/v3/users/7b1089a05ca74ff8aeee009f92eca35d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:19.497277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:19.507617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba63dd-ecf8-487a-b12d-3f51fa74040f None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:19.563277 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:19.564140 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:19.564421 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:19.564694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] PATH_INFO: `/v3/projects/8523f918209142d1ac87d640aca35e01` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:19.565860 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8523f918209142d1ac87d640aca35e01)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:19.567793 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:19.610742 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8523f918209142d1ac87d640aca35e01', 'request_id': 'req-8ce3857a-1640-4e34-b42b-8a018fefd060'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.616154 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8523f918209142d1ac87d640aca35e01', 'request_id': 'req-8ce3857a-1640-4e34-b42b-8a018fefd060'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.622555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8523f918209142d1ac87d640aca35e01', 'request_id': 'req-8ce3857a-1640-4e34-b42b-8a018fefd060'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.634147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] The token cache is being invalidate because project 8523f918209142d1ac87d640aca35e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:19.634371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.635003 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.636616 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1388/2773] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:19 2022] DELETE /identity/v3/projects/8523f918209142d1ac87d640aca35e01 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:19.640597 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:19.642038 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:19.655363 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e438f-f8f7-4b19-bf30-2a5b60eb369c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:19.708755 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:19.709619 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:19.709901 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:19.710174 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] PATH_INFO: `/v3/users/ef3cf1742ac342af98e92dd176708653` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:19.711390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3cf1742ac342af98e92dd176708653)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:19.713289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:19.757358 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3cf1742ac342af98e92dd176708653'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.758004 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3cf1742ac342af98e92dd176708653'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.769282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3cf1742ac342af98e92dd176708653'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.775863 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3cf1742ac342af98e92dd176708653'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.777028 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f06151b5-db9c-4411-bebf-a14db054bdf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3cf1742ac342af98e92dd176708653'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:19.788834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1386/2774] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:19 2022] DELETE /identity/v3/users/ef3cf1742ac342af98e92dd176708653 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:19.953005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:19.954477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:19.967918 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3857a-1640-4e34-b42b-8a018fefd060 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.023527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.024394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.024653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.024923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] PATH_INFO: `/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.026086 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3fd06b29784e08a9077b9f7c63bb71)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.028542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.072378 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3fd06b29784e08a9077b9f7c63bb71', 'request_id': 'req-ac293a84-e15c-4d97-82d0-d691d0cc2b12'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:20.078328 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3fd06b29784e08a9077b9f7c63bb71', 'request_id': 'req-ac293a84-e15c-4d97-82d0-d691d0cc2b12'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:20.084198 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3fd06b29784e08a9077b9f7c63bb71', 'request_id': 'req-ac293a84-e15c-4d97-82d0-d691d0cc2b12'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:20.097581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] The token cache is being invalidate because project 7f3fd06b29784e08a9077b9f7c63bb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:20.097864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:20.098475 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-ac293a84-e15c-4d97-82d0-d691d0cc2b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:20.100023 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1389/2775] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:19 2022] DELETE /identity/v3/projects/7f3fd06b29784e08a9077b9f7c63bb71 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:20.105072 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.105370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.105664 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.125505 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:20.126733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:20.184452 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1387/2776] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:20.192790 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.193095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.193368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.212542 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:20.213717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:20.221990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1390/2777] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:20.226339 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.235750 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561d2de-8bd8-49f2-b840-be8e9fffedbd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.240262 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.240905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.241185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.241458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.242167 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:50:20.242467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.244131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.255221 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1388/2778] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:50:20.259386 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.268756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb2094-f4cd-45b3-ae67-641d50a80493 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.273417 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.274046 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.274325 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.274597 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.275305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.277843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.301632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1391/2779] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:50:20.305741 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.315538 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c128b-b120-4f36-872f-a99c7d6e44e1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.369783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.370436 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.370717 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.370991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.371708 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.373589 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.392971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1389/2780] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:20.396456 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.406889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fa408-689f-4c52-9387-2ef4b4f5ebee admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.411470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.412179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.412460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.412730 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.413441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.415102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.425752 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1392/2781] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:20.429729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.440229 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb60ca5-dfa6-4863-aec2-7fecdb3a6b01 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.444745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.445387 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.445673 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.445945 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.446658 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.448277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59c463-2b99-4645-88b8-775b45ed35bf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.458641 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1390/2782] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:20.462573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.472473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f17e9-0d0b-4a4f-bd8c-14c15a2d14fb admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.477015 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.477869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.478145 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.478412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] PATH_INFO: `/v3/projects/55248fc525e846f98d2976db128d2605/users/c93d96a69ed045b7a5f42e7c08d66257/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.492585 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55248fc525e846f98d2976db128d2605, user_id=c93d96a69ed045b7a5f42e7c08d66257, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.495200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.508236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1393/2783] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:20 2022] PUT /identity/v3/projects/55248fc525e846f98d2976db128d2605/users/c93d96a69ed045b7a5f42e7c08d66257/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:20.520233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.520546 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.520822 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.546603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] MFA Rules not processed for user `c93d96a69ed045b7a5f42e7c08d66257`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:20.547821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:20.608790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1391/2784] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:20.613179 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.673503 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8cd3-b945-405b-8cd2-7b2285bc8656 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.678115 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.678763 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.679039 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.679344 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.680067 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.681949 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.706631 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1394/2785] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:20.710677 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.721133 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2e773-8884-4a33-abbd-cecd92d259b8 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.775001 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.775713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.775997 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.776273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.776954 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.778849 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.798137 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1392/2786] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:20 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:20.801980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.812606 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d034b-6d58-4eb2-8e0e-baeda0f8a7e8 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.817376 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.818025 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.818308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.818586 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.819335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.820961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.831507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1395/2787] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:20.835540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.845164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d97e-24c6-4b32-8f37-d510592b6b24 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.849643 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.850509 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.850790 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.851061 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] PATH_INFO: `/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234/users/5600d64278fb4ebcade9047572514597/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.866486 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d0e0b43bec4401ab3e3c38d4d84234, user_id=5600d64278fb4ebcade9047572514597, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.869129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.882718 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1393/2788] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:20 2022] PUT /identity/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234/users/5600d64278fb4ebcade9047572514597/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:20.887133 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.898519 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3460d8-3499-4567-89e7-06394c60b701 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.953142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.953789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.954065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.954330 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.955034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.956697 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517ca3e-04d5-47b1-8d85-b9aad69aec51 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:20.966244 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1396/2789] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:20.970254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:20.981110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eceee4-67e0-4557-984f-e03818bdb9ff admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:20.985655 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:20.986526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:20.986806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:20.987082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] PATH_INFO: `/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234/users/5600d64278fb4ebcade9047572514597/roles/991b05c688cb448e83689717b7104be0` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:20.989071 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d0e0b43bec4401ab3e3c38d4d84234, user_id=5600d64278fb4ebcade9047572514597, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:20.991765 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:21.002416 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1394/2790] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:20 2022] PUT /identity/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234/users/5600d64278fb4ebcade9047572514597/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:21.012507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:21.012804 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:21.013078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:21.038485 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] MFA Rules not processed for user `5600d64278fb4ebcade9047572514597`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:21.039707 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:21.103441 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1397/2791] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:21.114408 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:21.116081 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:21.171185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09969-adfa-4c7a-8f3d-1ccf5a4a5915 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:21.174749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:21.175405 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:21.175683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:21.175951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:21.184645 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:21.186040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725032a-d93b-4df5-a142-023ee7508754 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:21.195032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1395/2792] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:21.545907 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:21.605113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3572-0e9a-43ab-b65c-cc6daee70b74 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:21.609548 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:21.610396 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:21.610674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:21.610943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] PATH_INFO: `/v3/users/c93d96a69ed045b7a5f42e7c08d66257` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:21.612139 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93d96a69ed045b7a5f42e7c08d66257)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:21.614051 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:21.659483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93d96a69ed045b7a5f42e7c08d66257'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:21.660135 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93d96a69ed045b7a5f42e7c08d66257'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:21.676968 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93d96a69ed045b7a5f42e7c08d66257'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:21.684871 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93d96a69ed045b7a5f42e7c08d66257'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:21.692982 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93d96a69ed045b7a5f42e7c08d66257'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:21.701515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1398/2793] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:21 2022] DELETE /identity/v3/users/c93d96a69ed045b7a5f42e7c08d66257 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:21.706278 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:21.706566 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:21.706840 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:21.725168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:21.726342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:21.782267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1396/2794] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:50:21.791659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:21.793093 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:21.848280 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41aac-7399-4cbf-b6ab-6871588cd810 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:21.851864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:21.852497 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:21.852774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:21.853043 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:21.861582 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:21.862999 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:21.872125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1399/2795] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:50:22.144957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:22.146467 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:22.158586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb12292-27b6-4e05-a81d-e12d37e01895 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:22.163666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:22.164526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.164806 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.165074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] PATH_INFO: `/v3/projects/55248fc525e846f98d2976db128d2605` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.166256 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55248fc525e846f98d2976db128d2605)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:22.168215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:22.214450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55248fc525e846f98d2976db128d2605', 'request_id': 'req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.221794 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55248fc525e846f98d2976db128d2605', 'request_id': 'req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.227164 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55248fc525e846f98d2976db128d2605', 'request_id': 'req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.237905 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] The token cache is being invalidate because project 55248fc525e846f98d2976db128d2605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:22.238188 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.238808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.240427 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1397/2796] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:22 2022] DELETE /identity/v3/projects/55248fc525e846f98d2976db128d2605 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:22.244490 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:22.254282 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64d22e-33bf-4b97-a0ec-b3e077955687 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:22.308565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:22.309347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.309621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.309886 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] PATH_INFO: `/v3/users/5600d64278fb4ebcade9047572514597` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.311206 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5600d64278fb4ebcade9047572514597)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:22.313144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:22.355691 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5600d64278fb4ebcade9047572514597'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.356331 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5600d64278fb4ebcade9047572514597'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.367527 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5600d64278fb4ebcade9047572514597'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.375250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5600d64278fb4ebcade9047572514597'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.382529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-37e85606-e926-40e3-b0bb-e88101eb1720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5600d64278fb4ebcade9047572514597'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.389584 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1400/2797] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:22 2022] DELETE /identity/v3/users/5600d64278fb4ebcade9047572514597 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:22.646748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:22.648478 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:22.663204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2aa2a-ef76-4ba4-8302-825ab4ac898f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:22.718651 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:22.719557 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.719834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.720104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] PATH_INFO: `/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.721271 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d0e0b43bec4401ab3e3c38d4d84234)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:22.723284 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:22.768615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d0e0b43bec4401ab3e3c38d4d84234', 'request_id': 'req-6bf81520-0669-46e8-8c33-454e6904fa85'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.775560 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d0e0b43bec4401ab3e3c38d4d84234', 'request_id': 'req-6bf81520-0669-46e8-8c33-454e6904fa85'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.781498 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d0e0b43bec4401ab3e3c38d4d84234', 'request_id': 'req-6bf81520-0669-46e8-8c33-454e6904fa85'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.791881 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] The token cache is being invalidate because project e4d0e0b43bec4401ab3e3c38d4d84234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:22.792763 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.793383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-6bf81520-0669-46e8-8c33-454e6904fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:22.795139 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1398/2798] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:22 2022] DELETE /identity/v3/projects/e4d0e0b43bec4401ab3e3c38d4d84234 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:22.800687 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.801147 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.801269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.818035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:22.819199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:22.875890 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1401/2799] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:22.883656 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.883936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.884203 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.902124 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:22.903313 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:22.910951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1399/2800] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:22.914775 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:22.924859 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529f9d-6b58-44e5-8d61-dbca39c151e4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:22.929430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:22.930068 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.930347 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.930618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] PATH_INFO: `/v3/domains` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.931367 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:50:22.931673 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:22.933271 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:22.944237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1402/2801] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:50:22.948186 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:22.957391 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137fb07-2309-4e2e-9c16-c8cf405a68cf None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:22.961887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:22.962523 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:22.962796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:22.963063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:22.963782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:22.966179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:22.990441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1400/2802] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:22.994619 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.004146 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca465206-5499-496f-a46d-9688bc7c436c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.058502 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.059159 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.059505 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.059761 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.060434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.062334 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.082134 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1403/2803] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:22 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:23.086321 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.096846 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86547ee-c8fb-4de6-8472-c519cbf4d21f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.101385 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.102031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.102311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.102582 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.103328 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.104928 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.114886 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1401/2804] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:23.118534 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.128423 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdf9b-c914-4262-ad56-5a0ff883d43d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.132936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.133573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.133852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.134121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.134832 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.136972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31cc2-bde7-44ca-963d-e03200cb4f32 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.147121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1404/2805] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:23.150941 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.161217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062a7d-ba1e-4154-85af-1b7fd76b8607 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.165670 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.166525 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.166803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.167091 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] PATH_INFO: `/v3/projects/01679f0bc9d24937bf2a9e7c533aa5c6/users/de5d4315b37b468ab459ae09283149cd/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.181000 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=01679f0bc9d24937bf2a9e7c533aa5c6, user_id=de5d4315b37b468ab459ae09283149cd, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.183687 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.195838 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1402/2806] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:23 2022] PUT /identity/v3/projects/01679f0bc9d24937bf2a9e7c533aa5c6/users/de5d4315b37b468ab459ae09283149cd/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:23.207749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.208032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.208303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.234698 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] MFA Rules not processed for user `de5d4315b37b468ab459ae09283149cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:23.235903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:23.297319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1405/2807] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:23.301666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.361481 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a40f3-fe1c-4015-9eea-c1bcff41fabe admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.366096 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.366739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.367017 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.367304 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.367990 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.369855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.394617 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1403/2808] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:50:23.398579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.409677 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe727d-015a-4b59-92fe-2b979aa160f9 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.463281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.463971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.464256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.464529 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.465200 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.467121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.485973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1406/2809] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:23.490031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.500404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4658045-fa16-4f22-9c95-e54d487945c5 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.504887 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.505531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.505808 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.506074 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.506780 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.508375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.519470 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1404/2810] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:23.523253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.532797 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e20d7-2948-488f-abf5-0e4d9355dc81 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.537335 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.537971 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.538248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.538518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.539233 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.540833 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7e182-b3da-4095-a627-ad1f8674148c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.550262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1407/2811] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:23.554125 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.564301 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f5f64-1433-4b7a-b080-eb2c20a5270c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.568771 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.569630 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.569908 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.570179 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] PATH_INFO: `/v3/projects/f0940110566e4ef0b8a6beb1faba8f7c/users/f70ded0f068b4f8cb3f466a364ce9cd5/roles/834e56c266a046559104d936315ca310` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.585018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0940110566e4ef0b8a6beb1faba8f7c, user_id=f70ded0f068b4f8cb3f466a364ce9cd5, role_id=834e56c266a046559104d936315ca310)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.587714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.600407 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1405/2812] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:23 2022] PUT /identity/v3/projects/f0940110566e4ef0b8a6beb1faba8f7c/users/f70ded0f068b4f8cb3f466a364ce9cd5/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:23.610192 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.610477 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.610912 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.637791 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] MFA Rules not processed for user `f70ded0f068b4f8cb3f466a364ce9cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:23.638976 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:23.700507 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1408/2813] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:50:23.705234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.763307 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b029dc6-8c44-4485-9f65-121acb113ac7 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.767768 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.768406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.768685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.768956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.769644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.771528 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.795228 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1406/2814] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:23.799237 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.810319 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6babd1f-d30b-4c33-987c-a0507e13d8f7 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.863075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.863759 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.864032 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.864295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.864972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.866881 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.885988 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1409/2815] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:23 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:50:23.890009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.900009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdb17-4666-4b3e-a244-412602997fdf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.904545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.905190 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.905465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.905733 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.906440 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.908058 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.918610 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1407/2816] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:23.922863 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.932563 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f947ed6-57d5-4757-92b4-982f07938f7e admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:23.937694 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:23.938555 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:23.938830 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:23.939100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] PATH_INFO: `/v3/projects/66a5727980fb472084d101e9ec01fd9a/users/a87bfd747a8a448d8cb5850eaf68c703/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:23.953295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a5727980fb472084d101e9ec01fd9a, user_id=a87bfd747a8a448d8cb5850eaf68c703, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:23.955899 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:23.968169 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1410/2817] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:23 2022] PUT /identity/v3/projects/66a5727980fb472084d101e9ec01fd9a/users/a87bfd747a8a448d8cb5850eaf68c703/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:23.972215 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:23.982271 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccd9db-a30c-40f5-b836-05f9826dda8c admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:24.034721 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:24.035421 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:24.035700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:24.035971 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:24.036692 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:24.038246 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885890e-8c6f-46e4-aff0-3bff25797a0e admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:24.048202 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1408/2818] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 06:50:24.052443 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:24.062880 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0572493-7e35-4007-83be-a47854e53f1a admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:24.067362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:24.068227 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:24.068504 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:24.068774 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] PATH_INFO: `/v3/projects/66a5727980fb472084d101e9ec01fd9a/users/a87bfd747a8a448d8cb5850eaf68c703/roles/991b05c688cb448e83689717b7104be0` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:24.070721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a5727980fb472084d101e9ec01fd9a, user_id=a87bfd747a8a448d8cb5850eaf68c703, role_id=991b05c688cb448e83689717b7104be0)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:24.073387 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:24.083199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1411/2819] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:24 2022] PUT /identity/v3/projects/66a5727980fb472084d101e9ec01fd9a/users/a87bfd747a8a448d8cb5850eaf68c703/roles/991b05c688cb448e83689717b7104be0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:24.094315 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:24.094598 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:24.094870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:24.120212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] MFA Rules not processed for user `a87bfd747a8a448d8cb5850eaf68c703`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:24.121924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:24.186834 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1409/2820] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:24.198269 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:24.200011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:24.255301 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc90731-6ad0-4699-93db-3545e4f27746 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:24.258861 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:24.259530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:24.259810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:24.260081 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:24.313412 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:24.314920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:24.323608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1412/2821] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:25.789142 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:25.790554 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:25.802851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a17e-c8a6-43a5-ab29-614c8fd5ab22 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:25.806375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:25.807009 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:25.807319 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:25.807601 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:25.863798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:25.865208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:25.873935 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1410/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:26.369898 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:26.378343 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c740-0e3a-4f37-96f8-8bb9ba1cfd0d service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:26.381892 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:26.382512 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:26.382792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:26.383065 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:26.392180 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:26.393595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb4219-dc51-4879-9a88-33f279232d96 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:26.403364 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1413/2823] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:30.194378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:30.258879 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71c6-6068-4f80-957c-e31adf0c3739 service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:30.263383 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:30.264258 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:30.264542 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:30.264815 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] PATH_INFO: `/v3/users/de5d4315b37b468ab459ae09283149cd` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:30.265995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5d4315b37b468ab459ae09283149cd)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:30.267931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:30.311707 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5d4315b37b468ab459ae09283149cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.312354 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5d4315b37b468ab459ae09283149cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.323877 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5d4315b37b468ab459ae09283149cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.330713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5d4315b37b468ab459ae09283149cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.331384 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5d4315b37b468ab459ae09283149cd'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.344364 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1411/2824] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:30 2022] DELETE /identity/v3/users/de5d4315b37b468ab459ae09283149cd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:30.348905 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:30.349384 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:30.349484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:30.366517 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:30.367743 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:30.424160 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1414/2825] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:30.433851 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:30.435245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:30.490287 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa54d-8fd9-45a4-8a16-dab600919bc0 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:30.494107 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:30.494757 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:30.495041 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:30.495349 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:30.504346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:30.505761 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:30.515302 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1412/2826] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:30.779868 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:30.781397 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:30.794425 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d282e9-b88b-4786-9576-2772bd358917 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:30.800513 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:30.802324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:30.802834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:30.803094 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] PATH_INFO: `/v3/projects/01679f0bc9d24937bf2a9e7c533aa5c6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:30.804826 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01679f0bc9d24937bf2a9e7c533aa5c6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:30.807100 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:30.855546 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01679f0bc9d24937bf2a9e7c533aa5c6', 'request_id': 'req-803ca2d0-ca68-4090-98a4-516b90a69862'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.861038 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01679f0bc9d24937bf2a9e7c533aa5c6', 'request_id': 'req-803ca2d0-ca68-4090-98a4-516b90a69862'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.867090 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01679f0bc9d24937bf2a9e7c533aa5c6', 'request_id': 'req-803ca2d0-ca68-4090-98a4-516b90a69862'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.880473 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] The token cache is being invalidate because project 01679f0bc9d24937bf2a9e7c533aa5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:30.880756 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.881440 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:30.883075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1415/2827] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:30 2022] DELETE /identity/v3/projects/01679f0bc9d24937bf2a9e7c533aa5c6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:30.887639 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:30.897333 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5e6a-23a0-4502-aed1-0aa988cea484 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:30.954086 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:30.955050 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:30.955360 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:30.955634 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] PATH_INFO: `/v3/users/f70ded0f068b4f8cb3f466a364ce9cd5` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:30.956832 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70ded0f068b4f8cb3f466a364ce9cd5)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:30.958748 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:31.002198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70ded0f068b4f8cb3f466a364ce9cd5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.002850 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70ded0f068b4f8cb3f466a364ce9cd5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.014894 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70ded0f068b4f8cb3f466a364ce9cd5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.021435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70ded0f068b4f8cb3f466a364ce9cd5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.022138 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70ded0f068b4f8cb3f466a364ce9cd5'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.033955 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1413/2828] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:30 2022] DELETE /identity/v3/users/f70ded0f068b4f8cb3f466a364ce9cd5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:31.289448 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:31.290885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:31.304021 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca2d0-ca68-4090-98a4-516b90a69862 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:31.359511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:31.360381 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:31.360664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:31.360936 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] PATH_INFO: `/v3/projects/f0940110566e4ef0b8a6beb1faba8f7c` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:31.362199 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0940110566e4ef0b8a6beb1faba8f7c)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:31.364157 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:31.406723 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0940110566e4ef0b8a6beb1faba8f7c', 'request_id': 'req-c56928b3-333f-4eba-8816-e1501fb50d23'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.411836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0940110566e4ef0b8a6beb1faba8f7c', 'request_id': 'req-c56928b3-333f-4eba-8816-e1501fb50d23'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.418164 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0940110566e4ef0b8a6beb1faba8f7c', 'request_id': 'req-c56928b3-333f-4eba-8816-e1501fb50d23'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.434279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] The token cache is being invalidate because project f0940110566e4ef0b8a6beb1faba8f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:31.434560 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.435191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.436758 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1416/2829] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:31 2022] DELETE /identity/v3/projects/f0940110566e4ef0b8a6beb1faba8f7c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:31.440685 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:31.442063 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:31.454406 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbfc52-6925-4c61-a2f5-01137d1868d8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:31.507620 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:31.508411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:31.508683 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:31.508948 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] PATH_INFO: `/v3/users/a87bfd747a8a448d8cb5850eaf68c703` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:31.510129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87bfd747a8a448d8cb5850eaf68c703)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:31.512082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:31.556056 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87bfd747a8a448d8cb5850eaf68c703'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.556690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87bfd747a8a448d8cb5850eaf68c703'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.568729 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87bfd747a8a448d8cb5850eaf68c703'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.575438 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87bfd747a8a448d8cb5850eaf68c703'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.576309 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-c7da4a3c-4804-48b1-82c1-0cc900466464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87bfd747a8a448d8cb5850eaf68c703'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.588155 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1414/2830] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:50:31 2022] DELETE /identity/v3/users/a87bfd747a8a448d8cb5850eaf68c703 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:31.848126 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:31.849565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:31.862580 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56928b3-333f-4eba-8816-e1501fb50d23 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:31.918345 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:31.919191 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:31.919565 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:31.919835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] PATH_INFO: `/v3/projects/66a5727980fb472084d101e9ec01fd9a` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:31.920990 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a5727980fb472084d101e9ec01fd9a)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:31.922875 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:31.967568 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a5727980fb472084d101e9ec01fd9a', 'request_id': 'req-25c3e181-71c1-4ed0-961d-6ba1cb220278'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.972997 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a5727980fb472084d101e9ec01fd9a', 'request_id': 'req-25c3e181-71c1-4ed0-961d-6ba1cb220278'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.979097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a5727980fb472084d101e9ec01fd9a', 'request_id': 'req-25c3e181-71c1-4ed0-961d-6ba1cb220278'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.992234 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] The token cache is being invalidate because project 66a5727980fb472084d101e9ec01fd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:50:31.992630 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.993316 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-25c3e181-71c1-4ed0-961d-6ba1cb220278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:50:31.995308 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1417/2831] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:50:31 2022] DELETE /identity/v3/projects/66a5727980fb472084d101e9ec01fd9a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:50:31.999855 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.000212 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.000561 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.018939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:32.020173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:32.079572 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1415/2832] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:32.087207 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.087627 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.087796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.106398 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:32.107645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:32.115432 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1418/2833] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:32.119680 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.129082 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b58882-9031-46bc-bd7d-a6fad9a8383d None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.133607 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.134249 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.134530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.134800 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.135558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:50:32.136392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.137969 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.149093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1416/2834] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:50:32.153837 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.162923 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16185-c8f6-4d92-9af2-99ea02cb3090 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.167618 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.168295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.168573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.168843 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.169537 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.171428 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.195583 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1419/2835] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:50:32 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:32.200369 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.210233 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fbda2-bc1c-47b2-9fc6-37001411ce26 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.265534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.266195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.266474 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.266744 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.267465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.269378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.289055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1417/2836] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:50:32 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:50:32.292924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.302965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0576-4316-4da0-a691-8d109beec1de admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.307617 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.308264 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.308545 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.308817 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.309533 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.311125 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.321183 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1420/2837] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:32.325373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.335506 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dba65-65be-479a-bc97-28227eaed2b1 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.340606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.341521 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.341797 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.342069 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.342777 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.344382 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58470-3f61-488f-8c69-ab60e6f376fb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.354962 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1418/2838] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:50:32.358885 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.368509 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390f44e-4d29-4be3-b1cb-540ea3ed87dc admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.373113 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.373973 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.374253 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.374526 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] PATH_INFO: `/v3/projects/3ce3abdf08024c23b5dbe4d353057d94/users/99d0cd8a42c9463ba9dd90f9fcc10d36/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.388849 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce3abdf08024c23b5dbe4d353057d94, user_id=99d0cd8a42c9463ba9dd90f9fcc10d36, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.391520 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.404324 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1421/2839] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:50:32 2022] PUT /identity/v3/projects/3ce3abdf08024c23b5dbe4d353057d94/users/99d0cd8a42c9463ba9dd90f9fcc10d36/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:50:32.409281 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1af5-18c3-4a72-b689-2d5eea2dfabe None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.409570 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1af5-18c3-4a72-b689-2d5eea2dfabe None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.409844 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1af5-18c3-4a72-b689-2d5eea2dfabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.426390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-1a2f1af5-18c3-4a72-b689-2d5eea2dfabe None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:32.427632 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-1a2f1af5-18c3-4a72-b689-2d5eea2dfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:32.485485 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1419/2840] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:32.494869 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:32.497256 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:32.551092 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf261fb-a124-477d-aef5-6441b1620d7d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:32.554653 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:32.555310 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:32.555595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:32.555866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:32.565048 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:32.566470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:32.576660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1422/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:33.158527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97ae0-5715-4d61-8f08-7c4c57eefbec None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:33.158810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97ae0-5715-4d61-8f08-7c4c57eefbec None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:33.159087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97ae0-5715-4d61-8f08-7c4c57eefbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:33.187889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ffa97ae0-5715-4d61-8f08-7c4c57eefbec None None] MFA Rules not processed for user `99d0cd8a42c9463ba9dd90f9fcc10d36`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:33.189113 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ffa97ae0-5715-4d61-8f08-7c4c57eefbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:33.258158 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1420/2842] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:33.269470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:33.270958 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:33.328984 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533834ef-893a-4470-a5d5-59e9b9c3f0e0 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:33.332608 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:33.333258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:33.333518 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:33.333786 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:33.343942 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:33.345363 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:33.353932 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1423/2843] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:50:34.731563 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:34.732141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:34.732141 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:34.749110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] MFA Rules not processed for user `99d0cd8a42c9463ba9dd90f9fcc10d36`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:34.750290 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:34.757042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1421/2844] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:50:34.977914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:34.988248 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d50cd-17e1-45bd-b86b-956eb5dbdcde service cinder] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:34.991839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:34.992458 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:34.992733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:34.993002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:34.994721 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:35.003901 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:35.005292 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:35.012972 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1424/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:36.334127 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:36.335540 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:36.403600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542287a-ee54-4cca-a280-bd528200c43b None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:36.408738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:36.409390 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:36.409668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:36.409944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:36.411724 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:36.423374 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:36.424927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:36.435311 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1422/2846] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:50:44.219005 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:44.228809 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2f911-3732-4e9f-9b3f-6728bc4c55d8 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:44.236719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:44.237579 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:44.237925 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:44.238144 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:44.240105 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:44.251142 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:44.252636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:44.260736 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1425/2847] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:44.410065 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:44.411807 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:44.430200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe28d7-18f1-4f81-a02a-b6d89f6a37b0 service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:44.434904 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:44.435883 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:44.436411 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:44.436899 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:44.438872 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:44.553024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:44.554991 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a59d2-b68d-4582-b447-46dadb230d44 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:44.568951 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1423/2848] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:46.088559 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:46.090827 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:46.113098 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7238-641d-4855-9fe7-48e2c1d935c0 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:46.118727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:46.119927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:46.119927 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:46.120245 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:46.121810 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:46.134946 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:46.136762 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:46.150587 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1426/2849] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:46.654332 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:46.654853 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:46.654956 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:46.671738 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] MFA Rules not processed for user `94cdac893464447ea8753d29ac7c629b`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:46.672933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:46.726574 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1424/2850] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:50:47.199636 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:47.208931 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dfe0d-2f9f-4e1c-b697-d37081c2cb33 service nova] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:47.212657 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:47.213294 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:47.213577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:47.213864 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:47.215632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:47.225230 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:47.226789 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123f892-8dd8-4602-9b17-8b761e3ac96a service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:47.235158 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1427/2851] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:51.470713 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:50:51.484697 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3899-67dc-4b04-b28e-00210ba5c76a None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:50:51.490615 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8526efe49fd469bb829106580483ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:50:51.491393 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:51.491746 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:51.492093 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:51.494024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:51.507031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:50:51.508644 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d525f7-e139-45d6-95d3-dc8e6d91b007 service nova] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:50:51.520342 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1425/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:50:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:50:52.737638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:50:52.738122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:50:52.738225 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:50:52.755123 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] MFA Rules not processed for user `99d0cd8a42c9463ba9dd90f9fcc10d36`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:50:52.756349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:50:52.763966 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1428/2853] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:50:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:13.266267 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d1ef-f56e-4b21-88e6-c7fe99dcc3cf None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:13.266788 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d1ef-f56e-4b21-88e6-c7fe99dcc3cf None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:13.266902 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d1ef-f56e-4b21-88e6-c7fe99dcc3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:13.293567 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-b7d5d1ef-f56e-4b21-88e6-c7fe99dcc3cf None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:13.294749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-b7d5d1ef-f56e-4b21-88e6-c7fe99dcc3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:13.366958 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1426/2854] 10.222.0.64 () {58 vars in 1009 bytes} [Wed May 11 06:51:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:13.414430 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:13.415947 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:13.512872 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1455f38-d47f-476b-a3a0-ff93c9da22aa None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:13.517779 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:13.518407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:13.518682 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:13.518952 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:13.526896 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:13.528484 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:13.536075 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1429/2855] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:51:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:51:27.815675 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:27.816185 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:27.816298 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:27.833888 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] MFA Rules not processed for user `59f12c409d534a7a8937a1875d421c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:27.835067 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:27.842210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1427/2856] 10.222.0.64 () {58 vars in 967 bytes} [Wed May 11 06:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:27.854732 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:27.864967 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edaba5-1a47-4da9-95f6-f74910d24e2a service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:27.870573 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '179b4ae6970d49be8579745634c8ec67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:27.871190 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:27.871500 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:27.871778 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:27.879599 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:27.881149 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:27.888924 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1430/2857] 10.222.0.64 () {60 vars in 1384 bytes} [Wed May 11 06:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 06:51:29.757992 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:29.788457 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff382752-11e0-402a-96e1-ca7741a1a277 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:29.793636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:29.794531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:29.794812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:29.795204 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] PATH_INFO: `/v3/users/99d0cd8a42c9463ba9dd90f9fcc10d36` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:29.796517 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d0cd8a42c9463ba9dd90f9fcc10d36)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:29.798431 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:29.842960 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d0cd8a42c9463ba9dd90f9fcc10d36'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:29.843613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d0cd8a42c9463ba9dd90f9fcc10d36'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:29.855120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d0cd8a42c9463ba9dd90f9fcc10d36'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:29.861745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d0cd8a42c9463ba9dd90f9fcc10d36'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:29.862378 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-e11a46c3-ca06-4054-98f2-be70fd5c4aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d0cd8a42c9463ba9dd90f9fcc10d36'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:29.875555 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1428/2858] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:51:29 2022] DELETE /identity/v3/users/99d0cd8a42c9463ba9dd90f9fcc10d36 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:30.043368 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.054447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a441b-2a36-44bb-aac4-e92a8336df24 service swift] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.111129 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.112012 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.112296 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.112570 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] PATH_INFO: `/v3/projects/3ce3abdf08024c23b5dbe4d353057d94` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.113740 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce3abdf08024c23b5dbe4d353057d94)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.115676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.159708 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce3abdf08024c23b5dbe4d353057d94', 'request_id': 'req-be2e35b8-6479-4d07-8f98-5701100d2ea1'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.164914 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce3abdf08024c23b5dbe4d353057d94', 'request_id': 'req-be2e35b8-6479-4d07-8f98-5701100d2ea1'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.170836 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce3abdf08024c23b5dbe4d353057d94', 'request_id': 'req-be2e35b8-6479-4d07-8f98-5701100d2ea1'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.194175 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] The token cache is being invalidate because project 3ce3abdf08024c23b5dbe4d353057d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:51:30.194460 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.195078 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-be2e35b8-6479-4d07-8f98-5701100d2ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.196643 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1431/2859] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:51:30 2022] DELETE /identity/v3/projects/3ce3abdf08024c23b5dbe4d353057d94 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:30.202606 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.202967 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.203245 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.257023 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:30.258236 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:30.312613 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1429/2860] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:51:30.320980 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.321298 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.321577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.339660 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:30.340853 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:30.348679 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1432/2861] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:30.352871 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.362370 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3766b-a58e-4f36-84bc-9a1800f98acd None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.366858 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.367530 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.367812 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.368085 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.368798 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:51:30.369104 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.371182 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.382234 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1430/2862] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 06:51:30.386965 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.395877 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8954-6a96-4942-9f16-c2e138e72917 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.400459 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.401102 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.401385 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.401667 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.402362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.404313 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.430954 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1433/2863] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:51:30 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:51:30.435254 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.445022 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcfb08-039c-41b3-96eb-72f55816cfb8 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.499055 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.499782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.500062 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.500338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.501031 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.502920 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.521839 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1431/2864] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:51:30 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:51:30.525916 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.535796 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aaff5-4f40-4ba1-9e57-a09401a58d49 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.540447 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.541622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.541903 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.542174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.542887 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.544515 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.554088 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1434/2865] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:51:30.558346 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.567913 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4030670-7755-408d-8225-d69c92647fd4 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.572511 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.573172 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.573450 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.573720 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.574441 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.576040 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244490-2193-4d6d-a48b-74c920b986eb admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.585964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1432/2866] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:51:30.590091 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.599719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666f00-638b-4476-99f3-7a1007534e59 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.604955 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.605816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.606095 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.606394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] PATH_INFO: `/v3/projects/4a0e5ed29c684340af82227f84dabb23/users/86be0407e0b74942891cb7d61da61255/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.620873 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0e5ed29c684340af82227f84dabb23, user_id=86be0407e0b74942891cb7d61da61255, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.623531 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.635645 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1435/2867] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:51:30 2022] PUT /identity/v3/projects/4a0e5ed29c684340af82227f84dabb23/users/86be0407e0b74942891cb7d61da61255/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:51:30.645299 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.645586 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.645860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.671999 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] MFA Rules not processed for user `86be0407e0b74942891cb7d61da61255`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:30.673120 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:30.733848 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1433/2868] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:30.745632 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.747755 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:30.804614 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b34d-0add-42f3-a343-6df1b842ede7 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.808941 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.809577 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.809852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.810122 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.818174 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.819626 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5005ef0-52ca-4420-ae47-571230af5f41 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.828279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1436/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:51:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:30.852476 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:30.912996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae7dd-11ee-4441-b19e-329fe376fa42 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:30.918070 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:30.918929 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:30.919205 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:30.919502 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] PATH_INFO: `/v3/users/86be0407e0b74942891cb7d61da61255` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:30.920694 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86be0407e0b74942891cb7d61da61255)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:30.922647 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:30.967870 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86be0407e0b74942891cb7d61da61255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.968782 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86be0407e0b74942891cb7d61da61255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.980912 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86be0407e0b74942891cb7d61da61255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.987668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86be0407e0b74942891cb7d61da61255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:30.988400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86be0407e0b74942891cb7d61da61255'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.000593 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1434/2870] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:51:30 2022] DELETE /identity/v3/users/86be0407e0b74942891cb7d61da61255 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:31.005059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.005340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.005611 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.021889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:31.023097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:31.079163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1437/2871] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 06:51:31.089199 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.090577 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:31.164835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004faf8-6d37-4bee-8812-b24cb4c272b6 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.169034 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.169667 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.169949 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.170225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.179077 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.180458 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ba8a-2679-4393-a03c-6c3ec86bc3dd service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.189603 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1435/2872] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:31.449079 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.450472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:31.462598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985cef-f9bb-4b5f-9088-1fcbaf28afa4 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.468016 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.468870 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.469153 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.469429 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] PATH_INFO: `/v3/projects/4a0e5ed29c684340af82227f84dabb23` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.470615 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0e5ed29c684340af82227f84dabb23)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.472664 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.517059 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0e5ed29c684340af82227f84dabb23', 'request_id': 'req-6dba421c-7b92-4807-8dd6-498b46ef15af'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.522279 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0e5ed29c684340af82227f84dabb23', 'request_id': 'req-6dba421c-7b92-4807-8dd6-498b46ef15af'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.528801 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0e5ed29c684340af82227f84dabb23', 'request_id': 'req-6dba421c-7b92-4807-8dd6-498b46ef15af'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.540281 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] The token cache is being invalidate because project 4a0e5ed29c684340af82227f84dabb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:51:31.540564 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.541182 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-6dba421c-7b92-4807-8dd6-498b46ef15af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:31.542700 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1438/2873] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:51:31 2022] DELETE /identity/v3/projects/4a0e5ed29c684340af82227f84dabb23 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:31.547672 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.547982 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.548282 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.565700 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:31.566907 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:31.623564 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1436/2874] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:31.631352 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441550-f300-4187-b700-48a861d294c5 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.631641 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441550-f300-4187-b700-48a861d294c5 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.631920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441550-f300-4187-b700-48a861d294c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.649904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-9b441550-f300-4187-b700-48a861d294c5 None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:31.651717 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9b441550-f300-4187-b700-48a861d294c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:31.659847 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1439/2875] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:31.663931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.673312 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcb369-89ee-4f42-ab0a-d52dfc115ff1 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.677795 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.678435 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.678714 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.678984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] PATH_INFO: `/v3/domains` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.679739 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 06:51:31.680045 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.682173 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.693087 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1437/2876] 10.222.0.64 () {58 vars in 1152 bytes} [Wed May 11 06:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 06:51:31.697082 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b441550-f300-4187-b700-48a861d294c5 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.706839 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b441550-f300-4187-b700-48a861d294c5 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.711438 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.712070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.712349 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.712621 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] PATH_INFO: `/v3/projects` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.713300 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.715166 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.739822 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1440/2877] 10.222.0.64 () {60 vars in 1152 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 06:51:31.743734 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.753919 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3366ed0-ccef-48f0-8831-ee1ee6611daf admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.806543 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.807732 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.808016 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.808289 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] PATH_INFO: `/v3/users` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.809006 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.810924 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.830042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1438/2878] 10.222.0.64 () {60 vars in 1143 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 06:51:31.833944 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.843846 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc8c3-6660-4a8f-aabd-f47f65e8f258 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.848602 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.849247 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.849528 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.849800 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] PATH_INFO: `/v3/roles` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.850506 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.852121 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.862302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1441/2879] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:51:31.866020 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.876375 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863e958-7ad9-40ba-9bf6-0e23cdf8bb95 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.880984 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.881631 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.881944 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.882219 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.882936 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.884558 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66867edc-bca5-4387-ac10-95fee168b766 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.896668 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1439/2880] 10.222.0.64 () {58 vars in 1121 bytes} [Wed May 11 06:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 06:51:31.900878 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:31.910538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da30e05-2fe6-43f7-a74c-bd40c750831c admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:31.915128 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:31.916208 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] REQUEST_METHOD: `PUT` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.916530 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.916803 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] PATH_INFO: `/v3/projects/aa0d76194eb24284b429d1d08924f7e6/users/fb87463e49874521bc38bd0955f44725/roles/834e56c266a046559104d936315ca310` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.930522 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0d76194eb24284b429d1d08924f7e6, user_id=fb87463e49874521bc38bd0955f44725, role_id=834e56c266a046559104d936315ca310)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:31.933747 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:31.945851 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1442/2881] 10.222.0.64 () {60 vars in 1482 bytes} [Wed May 11 06:51:31 2022] PUT /identity/v3/projects/aa0d76194eb24284b429d1d08924f7e6/users/fb87463e49874521bc38bd0955f44725/roles/834e56c266a046559104d936315ca310 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:31.958373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] REQUEST_METHOD: `POST` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:31.958657 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:31.958931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:31.984042 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.auth.core [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] MFA Rules not processed for user `fb87463e49874521bc38bd0955f44725`. Rule list: `[]` (Enabled: `True`). {{(pid=79984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:31.985292 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:32.046690 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1440/2882] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:32.057879 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:32.059566 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:32.114070 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb52cf-e396-4ead-b555-c34c89bbaacf admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:32.117674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:32.118303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:32.118581 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:32.118866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:32.127470 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:32.128883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d3e6a-7ce0-48a9-9f6c-9e6b5e4b8e82 service cinder] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:32.137395 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1443/2883] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:51:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:50.393325 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:50.452986 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966613e-eda8-43a6-8318-fc6796451236 None None] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:50.457442 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:50.458300 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:50.458579 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:50.458854 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] PATH_INFO: `/v3/users/fb87463e49874521bc38bd0955f44725` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:50.460048 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb87463e49874521bc38bd0955f44725)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:50.461957 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:50.504526 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb87463e49874521bc38bd0955f44725'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:50.505163 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb87463e49874521bc38bd0955f44725'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:50.516322 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb87463e49874521bc38bd0955f44725'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:50.522754 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb87463e49874521bc38bd0955f44725'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:50.523412 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb87463e49874521bc38bd0955f44725'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:50.536210 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1441/2884] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:51:50 2022] DELETE /identity/v3/users/fb87463e49874521bc38bd0955f44725 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:51:50.540727 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:50.541787 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:50.541904 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:50.558278 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] MFA Rules not processed for user `3d67c7af6def40d481bce9d42fed2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:51:50.559538 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:50.615097 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1444/2885] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:51:50.625032 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:50.626373 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:50.681874 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8420b-e078-43af-bfa6-ae53755e7026 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:50.685465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:50.686095 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:50.686371 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:50.686652 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:50.695400 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:50.696803 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:50.706243 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1442/2886] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:51:50.968858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:51:50.970403 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:51:50.984823 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdee90-ceb4-4fd3-81c4-aba1bc3b7b8a None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:51:50.990733 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:51:50.991595 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:51:50.991777 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:51:50.992052 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] PATH_INFO: `/v3/projects/aa0d76194eb24284b429d1d08924f7e6` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:51:50.993327 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0d76194eb24284b429d1d08924f7e6)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:51:50.995163 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:51:51.040464 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0d76194eb24284b429d1d08924f7e6', 'request_id': 'req-1af7ca62-7543-4f67-9913-3d8e33d3693d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:51.046034 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0d76194eb24284b429d1d08924f7e6', 'request_id': 'req-1af7ca62-7543-4f67-9913-3d8e33d3693d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:51.052009 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0d76194eb24284b429d1d08924f7e6', 'request_id': 'req-1af7ca62-7543-4f67-9913-3d8e33d3693d'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:51.065305 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] The token cache is being invalidate because project aa0d76194eb24284b429d1d08924f7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:51:51.065819 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:51.066834 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:51:51.069118 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1445/2887] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:51:50 2022] DELETE /identity/v3/projects/aa0d76194eb24284b429d1d08924f7e6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:52:13.357666 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:13.359047 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:13.445520 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9714-390b-4fab-bb24-6e13d4357f9e service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:13.501809 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:13.502446 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:13.502723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:13.502995 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:13.504762 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:13.515933 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:13.517466 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:13.527556 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1443/2888] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:52:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:52:35.461436 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:35.463543 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:35.518798 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ca62-7543-4f67-9913-3d8e33d3693d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:35.522994 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:35.523734 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:35.524014 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:35.524302 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:35.526637 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:35.590866 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:35.592254 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:35.603238 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1446/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:52:37.177926 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:37.179404 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:37.195531 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ca14-ab41-4583-8272-b4bb5bd06d9b service placement] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:37.200337 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:37.201208 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:37.201491 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:37.201766 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] PATH_INFO: `/v3/users/f0b99029c246448da0a2d0e26a16f43d` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:37.203217 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b99029c246448da0a2d0e26a16f43d)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:37.205152 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:37.249730 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b99029c246448da0a2d0e26a16f43d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.250395 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b99029c246448da0a2d0e26a16f43d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.261835 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b99029c246448da0a2d0e26a16f43d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.268345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b99029c246448da0a2d0e26a16f43d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.268996 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b99029c246448da0a2d0e26a16f43d'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.281193 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1444/2890] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:52:37 2022] DELETE /identity/v3/users/f0b99029c246448da0a2d0e26a16f43d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:52:37.449240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:37.459943 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9fdb-b5bd-4e7e-b055-d0f386c52453 service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:37.517262 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:37.518120 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:37.518401 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:37.518676 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] PATH_INFO: `/v3/projects/e6758effb73344c895a7ed675378f8df` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:37.519957 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6758effb73344c895a7ed675378f8df)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:37.521858 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:37.567511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6758effb73344c895a7ed675378f8df', 'request_id': 'req-868c94a2-108b-4c33-a2eb-adc81a2e3a11'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.573303 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6758effb73344c895a7ed675378f8df', 'request_id': 'req-868c94a2-108b-4c33-a2eb-adc81a2e3a11'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.579446 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6758effb73344c895a7ed675378f8df', 'request_id': 'req-868c94a2-108b-4c33-a2eb-adc81a2e3a11'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.591489 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] The token cache is being invalidate because project e6758effb73344c895a7ed675378f8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:52:37.591769 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.592373 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.593893 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1447/2891] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:52:37 2022] DELETE /identity/v3/projects/e6758effb73344c895a7ed675378f8df => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:52:37.597823 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:37.599198 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:37.611731 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964308-3a52-4bcf-b089-716ada5eb9ce admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:37.665338 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:37.666200 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:37.666475 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:37.666745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] PATH_INFO: `/v3/users/2b50354768eb4011959150f1f1dc7323` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:37.667927 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b50354768eb4011959150f1f1dc7323)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:37.669810 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:37.714207 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b50354768eb4011959150f1f1dc7323'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.714783 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b50354768eb4011959150f1f1dc7323'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.725964 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b50354768eb4011959150f1f1dc7323'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.732488 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b50354768eb4011959150f1f1dc7323'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.733110 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b50354768eb4011959150f1f1dc7323'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:37.746129 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1445/2892] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:52:37 2022] DELETE /identity/v3/users/2b50354768eb4011959150f1f1dc7323 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:52:37.912394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:52:37.913795 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:52:37.926080 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c94a2-108b-4c33-a2eb-adc81a2e3a11 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:52:37.982852 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:52:37.983674 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:52:37.983961 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:52:37.984236 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] PATH_INFO: `/v3/projects/fa899b4ee1304564bc11486c61a0ea66` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:52:37.985409 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa899b4ee1304564bc11486c61a0ea66)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:52:37.987336 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:52:38.030483 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa899b4ee1304564bc11486c61a0ea66', 'request_id': 'req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:38.035828 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa899b4ee1304564bc11486c61a0ea66', 'request_id': 'req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:38.042255 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa899b4ee1304564bc11486c61a0ea66', 'request_id': 'req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:38.053406 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] The token cache is being invalidate because project fa899b4ee1304564bc11486c61a0ea66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:52:38.053688 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:38.054295 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3a8a9701-ec50-4ba2-ab68-e5711c771cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:52:38.056472 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1448/2893] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:52:37 2022] DELETE /identity/v3/projects/fa899b4ee1304564bc11486c61a0ea66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:53:00.997903 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:53:00.999372 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:01.073909 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250cda-4fe4-4d55-a86e-46334e224531 admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:53:01.121273 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48b44bd541f4b448ccd6ee0f060a011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:53:01.121917 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:01.122195 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:01.122465 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:01.124265 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:01.178277 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:53:01.179723 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:53:01.188866 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1446/2894] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:53:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:53:06.925883 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] REQUEST_METHOD: `POST` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:53:06.926394 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:53:06.926511 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:53:06.943814 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.auth.core [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] MFA Rules not processed for user `94cdac893464447ea8753d29ac7c629b`. Rule list: `[]` (Enabled: `True`). {{(pid=79985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 06:53:06.945008 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:53:06.952232 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1449/2895] 10.222.0.64 () {58 vars in 957 bytes} [Wed May 11 06:53:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 06:54:54.741130 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:54:54.742545 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:54:54.801532 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb69f-975e-45b9-b4fb-ae1af547bcfa service cinder] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:54:54.805025 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:54:54.805665 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:54:54.805939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:54:54.806211 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:54:54.808534 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:54:54.895253 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:54:54.896696 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:54:54.916772 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1447/2896] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:54:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:54:56.092007 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:54:56.101321 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c893ad3-e30f-4ab9-9166-156f1890b5a8 None None] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:54:56.104841 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:54:56.105462 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:54:56.105737 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:54:56.106002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:54:56.107749 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:54:56.121371 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:54:56.122816 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:54:56.133818 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1450/2897] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 06:55:06.887024 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:06.895931 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4b99-2c45-445c-ac4f-0cb5a4f95340 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:06.899600 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a37ec62dd1334df8b9870c43c609aac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:06.900240 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:06.900515 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:06.900784 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:06.903039 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:06.964469 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:06.965860 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:06.975414 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1448/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 06:55:13.616889 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:13.620315 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:13.639222 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10016-cd3e-44c6-a776-82aeff907c6e service neutron] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:13.643835 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:13.644714 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:13.644985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:13.645250 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] PATH_INFO: `/v3/users/94cdac893464447ea8753d29ac7c629b` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:13.646407 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94cdac893464447ea8753d29ac7c629b)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:13.648340 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:13.693719 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94cdac893464447ea8753d29ac7c629b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.694372 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94cdac893464447ea8753d29ac7c629b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.707659 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94cdac893464447ea8753d29ac7c629b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.714598 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94cdac893464447ea8753d29ac7c629b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.722360 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94cdac893464447ea8753d29ac7c629b'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:13.728638 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1451/2899] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:55:13 2022] DELETE /identity/v3/users/94cdac893464447ea8753d29ac7c629b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:13.904011 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:13.914052 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a39b-78c0-4cf9-813a-a94a71897bd1 service neutron] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:13.969399 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:13.970250 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:13.970527 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:13.970796 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] PATH_INFO: `/v3/projects/549cd5f2cff143c69dd1e4568d7bd3e6` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:13.971939 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] RBAC: Authorizing `identity:delete_project(project_id=549cd5f2cff143c69dd1e4568d7bd3e6)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:13.974018 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.020303 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549cd5f2cff143c69dd1e4568d7bd3e6', 'request_id': 'req-adb34059-d08e-48e0-879b-0ada6e6e049f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.027392 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549cd5f2cff143c69dd1e4568d7bd3e6', 'request_id': 'req-adb34059-d08e-48e0-879b-0ada6e6e049f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.033119 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549cd5f2cff143c69dd1e4568d7bd3e6', 'request_id': 'req-adb34059-d08e-48e0-879b-0ada6e6e049f'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.049745 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] The token cache is being invalidate because project 549cd5f2cff143c69dd1e4568d7bd3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:14.050059 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.050749 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.052345 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1449/2900] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:55:13 2022] DELETE /identity/v3/projects/549cd5f2cff143c69dd1e4568d7bd3e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:55:14.056501 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.058493 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.071369 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c703-b97f-42c1-a598-bce2c588941d admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.129362 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.130240 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.130516 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.130784 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] PATH_INFO: `/v3/users/c3f5480dfddc45a88cd579f7cf12fd29` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.132011 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f5480dfddc45a88cd579f7cf12fd29)` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.133909 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.178410 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f5480dfddc45a88cd579f7cf12fd29'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.178975 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f5480dfddc45a88cd579f7cf12fd29'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.192148 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f5480dfddc45a88cd579f7cf12fd29'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.198985 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f5480dfddc45a88cd579f7cf12fd29'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.206106 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.notifications [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f5480dfddc45a88cd579f7cf12fd29'} {{(pid=79985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.211895 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1452/2901] 10.222.0.64 () {58 vars in 1223 bytes} [Wed May 11 06:55:14 2022] DELETE /identity/v3/users/c3f5480dfddc45a88cd579f7cf12fd29 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 06:55:14.376636 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Authenticating user token {{(pid=79984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:55:14.378135 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.fernet_utils [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:55:14.393231 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34059-d08e-48e0-879b-0ada6e6e049f admin admin] Validating token access rules against request {{(pid=79984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:55:14.452054 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d67c7af6def40d481bce9d42fed2d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cddb71d6492441b395049ab068255bc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:55:14.452915 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:55:14.453196 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:55:14.453468 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] PATH_INFO: `/v3/projects/7d282e90f748416c8a2a2cae914bc1f7` {{(pid=79984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:55:14.454889 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d282e90f748416c8a2a2cae914bc1f7)` {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:55:14.456821 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] RBAC: Authorization granted {{(pid=79984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:55:14.501359 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d282e90f748416c8a2a2cae914bc1f7', 'request_id': 'req-0e525225-4098-442c-85fc-df9e40572184'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.508168 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d282e90f748416c8a2a2cae914bc1f7', 'request_id': 'req-0e525225-4098-442c-85fc-df9e40572184'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.513595 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d282e90f748416c8a2a2cae914bc1f7', 'request_id': 'req-0e525225-4098-442c-85fc-df9e40572184'} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.524225 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] The token cache is being invalidate because project 7d282e90f748416c8a2a2cae914bc1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 06:55:14.524510 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.525131 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: DEBUG keystone.notifications [None req-0e525225-4098-442c-85fc-df9e40572184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 06:55:14.527189 dv-cinder-804757-27-iscsi devstack@keystone.service[79984]: [pid: 79984|app: 0|req: 1450/2902] 10.222.0.64 () {58 vars in 1232 bytes} [Wed May 11 06:55:14 2022] DELETE /identity/v3/projects/7d282e90f748416c8a2a2cae914bc1f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 06:57:16.302035 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Authenticating user token {{(pid=79985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 06:57:16.303434 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.369258 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be7da-66c3-4198-8641-6d3df3e51077 admin admin] Validating token access rules against request {{(pid=79985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 06:57:16.426127 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40643ca4e4db4ce6b0a692bb06cc6dc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e744a9413ae44999bc4a9c57c7a2389b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 06:57:16.426792 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] REQUEST_METHOD: `GET` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 06:57:16.427211 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] SCRIPT_NAME: `/identity` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 06:57:16.427521 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 06:57:16.429337 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.fernet_utils [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 06:57:16.441002 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 06:57:16.442622 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979d79-a6d6-47de-98b2-be7d8a4da714 service placement] RBAC: Authorization granted {{(pid=79985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 06:57:16.452920 dv-cinder-804757-27-iscsi devstack@keystone.service[79985]: [pid: 79985|app: 0|req: 1453/2903] 10.222.0.64 () {60 vars in 1365 bytes} [Wed May 11 06:57:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)